-- Logs begin at Tue 2022-06-21 05:13:25 UTC, end at Tue 2022-06-21 06:14:33 UTC. -- Jun 21 05:45:20.955675 dv-cinder-846901-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 05:45:20.963943 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 05:45:20 2022] *** Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: nodename: dv-cinder-846901-1-iscsi Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: machine: x86_64 Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: clock source: unix Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: pcre jit disabled Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: detected number of CPU cores: 4 Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: current working directory: / Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: detected binary path: /usr/bin/uwsgi-core Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: your processes number limit is 47680 Jun 21 05:45:20.965947 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: your memory page size is 4096 bytes Jun 21 05:45:20.966775 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: detected max file descriptor number: 2048 Jun 21 05:45:20.966775 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: lock engine: pthread robust mutexes Jun 21 05:45:20.966775 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: thunder lock: enabled Jun 21 05:45:20.966775 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 05:45:20.966775 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 05:45:21.009344 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: Python main interpreter initialized at 0x564ab78769c0 Jun 21 05:45:21.009344 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: python threads support enabled Jun 21 05:45:21.009344 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: your server socket listen backlog is limited to 100 connections Jun 21 05:45:21.009344 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: your mercy for graceful operations on workers is 90 seconds Jun 21 05:45:21.009716 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 05:45:21.009794 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: *** Operational MODE: preforking *** Jun 21 05:45:21.010087 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: *** uWSGI is running in multiple interpreter mode *** Jun 21 05:45:21.010087 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: spawned uWSGI master process (pid: 103054) Jun 21 05:45:21.010277 dv-cinder-846901-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 05:45:21.012065 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: spawned uWSGI worker 1 (pid: 103055, cores: 1) Jun 21 05:45:21.012065 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: spawned uWSGI worker 2 (pid: 103056, cores: 1) Jun 21 05:45:21.012065 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 05:45:21.668522 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 05:45:21.669131 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 05:45:22.799453 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:45:22.799453 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: from cryptography.utils import int_from_bytes Jun 21 05:45:22.800082 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:45:22.800082 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: from cryptography.utils import int_from_bytes Jun 21 05:45:22.807524 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:45:22.807524 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: from cryptography.utils import int_from_bytes Jun 21 05:45:22.808006 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:45:22.808006 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: from cryptography.utils import int_from_bytes Jun 21 05:45:25.280958 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 05:45:25.282072 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 05:45:25.282300 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 05:45:25.282666 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 05:45:25.282923 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 05:45:25.283311 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.283638 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.283961 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.284283 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.284615 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.284924 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.285246 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.285566 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.285893 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.286178 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.286494 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.286817 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846901-1-iscsi {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.287138 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.287443 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.287541 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 05:45:25.287895 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 05:45:25.287984 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.288070 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.288220 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 05:45:25.288342 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.288585 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 05:45:25.288683 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.288840 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 05:45:25.288932 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.289227 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.289430 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.289553 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.289867 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.289998 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.290195 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.290307 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.290506 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.290617 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.290835 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.290963 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.291147 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.291241 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.291455 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.291542 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.291781 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.291914 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.292044 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.292130 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.292359 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.292445 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.292700 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846901-1-iscsi {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.292850 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293006 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293095 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846901-1-iscsi {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293313 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293415 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293623 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293711 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.293954 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.294055 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.294269 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.294399 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.294614 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.294711 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.294891 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.295007 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.295329 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.295414 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.295652 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.295743 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.295960 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.296058 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.296275 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.296359 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.296591 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.296680 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.296966 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.297625 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.297782 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.297889 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.298143 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.298241 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.298452 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.298536 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.298763 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.298849 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299073 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299167 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299374 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299458 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846901-1-iscsi {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299676 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299770 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.299927 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.300073 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.300235 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.300386 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.300554 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.300796 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.300882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.301112 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.301196 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.301415 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.301512 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.301668 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.301756 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302006 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302106 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302327 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302420 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302634 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302720 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.302942 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303034 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303251 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303341 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303557 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303642 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303862 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.303948 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.304167 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.304253 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.304470 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.304555 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.304779 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.304875 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305085 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305179 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305390 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305476 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305644 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305740 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.305971 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.306074 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.306297 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.306383 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.306618 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.306712 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.306938 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307032 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307193 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307446 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307563 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307765 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.307865 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.308086 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.308173 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.308396 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.308482 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.308704 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.308789 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309012 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309106 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309320 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309407 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309713 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.309951 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310038 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310271 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310359 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310580 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310664 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310829 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.310927 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.311130 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.311260 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.311435 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.311520 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.311758 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.311855 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.312066 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.312152 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.312373 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.312486 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.312742 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.312828 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313053 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313216 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313353 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313498 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313641 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313822 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.313953 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.314156 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.314263 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.314478 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.314582 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.314807 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.314933 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.315435 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.315538 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.315608 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.315764 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.315839 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.315914 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316020 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316103 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316333 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316436 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316635 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316726 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316886 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.316974 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.317186 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.317286 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.317493 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.317597 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.317811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.317902 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.318138 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.318244 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.318445 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.318541 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.318750 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.318838 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319050 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319157 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319351 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319447 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319657 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319746 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.319959 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320055 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320262 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320350 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320568 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320658 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320863 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.320952 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.321168 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.321295 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.321476 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.321569 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.321780 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.321874 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.322107 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.322208 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.322419 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.322511 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.322712 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.322813 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323013 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323132 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323315 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323420 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323616 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323718 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.323920 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.324068 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.324215 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.324354 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.324526 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.324678 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325002 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325076 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325142 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325329 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325433 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325643 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325733 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.325980 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.326072 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.326294 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.326384 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.326604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.326701 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.326921 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.327022 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.327224 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.327314 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.327531 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.327621 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.327848 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.327945 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.328182 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.328280 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.328492 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.328582 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.328795 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.328894 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.329099 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.329190 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.329403 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.329499 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.329707 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.329805 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.330046 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.330147 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.330352 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.330442 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.330652 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.330750 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.330971 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.331067 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.331292 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.331382 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.331606 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.331703 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.331915 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.332007 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.332212 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.332303 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.332529 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.332626 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:45:25.332861 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.332954 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.333179 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.333277 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.333490 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.333587 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.333819 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.333922 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.334172 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.334279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.334486 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.334576 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.334808 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.334898 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.335119 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.335209 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.335429 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.335519 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.335738 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.335828 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336047 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336137 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336350 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336438 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336663 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336755 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.336979 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.337068 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.337295 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.337385 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.337604 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.337693 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.337914 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.338033 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.338243 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.338342 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.338554 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.338700 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.338863 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339024 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339182 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339324 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339494 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339634 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339806 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.339955 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.340116 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.340266 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.340430 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.340571 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.340740 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.340891 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.341047 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.341183 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.341329 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.341464 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.341633 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.341784 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342050 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342203 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342338 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342483 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342628 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342764 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.342918 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.343132 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.343273 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.343416 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.343566 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.343701 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.344415 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.344577 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.344728 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.344872 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345027 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345169 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345309 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345448 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345607 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345748 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.345901 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346070 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346223 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346364 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346515 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346670 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346818 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.346961 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.347101 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.347240 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.347380 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.347544 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.347686 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.347934 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.348081 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.348222 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.348362 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.348525 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.348921 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349071 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349213 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349353 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349493 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349653 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349796 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.349982 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.350135 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.350285 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.350436 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.350617 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.350759 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.350898 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351049 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351192 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351340 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351482 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351641 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351790 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.351932 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.352071 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.352314 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.352462 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.352604 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.352752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.352894 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.353041 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.353283 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.353440 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.353590 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.353741 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.353891 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.354069 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.354212 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.354353 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.354583 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.354732 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.354882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355032 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355184 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355326 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355476 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355617 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355778 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.355929 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356078 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356233 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356379 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356528 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356670 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356819 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.356961 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.357114 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.357256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.357396 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.357565 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.357713 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.357856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358045 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358339 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358489 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358639 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358781 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.358921 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.359078 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.359221 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.359393 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360102 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360246 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360386 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360527 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360667 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360816 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.360958 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.361106 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.361247 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.361395 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.361550 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.361700 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.361842 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.362049 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.362198 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.362422 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.362580 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.362732 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.362881 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.363024 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.363164 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.363435 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.363601 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.363754 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.363896 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364037 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364189 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364330 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364480 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364702 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364852 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.364993 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.365133 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.365273 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.365423 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.365565 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.365723 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.365866 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.366085 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.366317 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.366465 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.366607 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.366755 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.366899 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367039 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367189 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367331 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367471 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367611 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367761 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.367908 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368072 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368214 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368354 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368502 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368644 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368784 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.368937 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369087 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369230 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369370 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369517 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369667 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369809 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.369983 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.370143 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.370286 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.370426 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.370575 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.370723 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.370871 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371019 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371162 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371302 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371451 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371594 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371735 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.371885 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372036 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372179 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372328 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372552 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372701 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372844 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.372985 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.373135 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.373135 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.373498 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.373646 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.373794 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.373970 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.374130 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.374281 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.374430 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.374572 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.374736 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.374944 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.375156 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.375303 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.375444 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.375592 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.375733 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.375892 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376043 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376185 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376332 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376483 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376633 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376781 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.376931 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.377073 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.377227 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.377371 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.377519 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.377669 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.377828 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378008 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378155 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378306 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378449 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378599 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378741 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.378882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379022 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379230 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379383 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379535 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379677 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379828 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.379969 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380115 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380256 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380414 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380557 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380697 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380836 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.380983 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.381134 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.381283 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.381432 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.381574 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.381761 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.381916 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.382098 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.382240 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.382396 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.382555 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.382767 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.382921 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.383072 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.383213 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.383353 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.383510 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.383719 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.383887 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384043 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384186 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384332 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384480 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384622 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384771 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.384913 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.385136 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.385282 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.385423 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.385562 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.385722 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.385865 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386037 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386180 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386330 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386483 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386634 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386782 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.386924 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387064 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387204 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387350 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387501 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387661 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387803 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387952 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.387952 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.388229 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.388372 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.388519 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.388660 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.388800 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.388952 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.389102 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.389250 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.389391 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.389548 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.389690 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.389829 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.390005 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.390153 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.390294 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.390433 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.390573 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.391258 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.391410 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.391560 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.391703 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.391843 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.392001 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.392144 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.392284 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.392500 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.392650 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.392816 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.393028 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.393183 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.393333 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.393483 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.393625 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.393847 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394043 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394190 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394343 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394492 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394633 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394781 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.394923 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.395070 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.395301 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.395301 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.395578 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.395720 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.395867 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396020 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396173 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396317 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396458 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396598 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396753 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396907 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.396907 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.397183 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.397325 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.397465 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.397644 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.397799 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.397980 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.398130 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.398284 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.398436 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.398578 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.398726 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.398880 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399023 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399164 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399312 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399455 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399596 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399756 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.399898 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400046 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400188 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400329 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400471 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400620 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400774 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.400918 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.401059 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.401199 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.401339 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.401489 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.401648 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.401801 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402011 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402178 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402329 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402472 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402613 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402763 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.402905 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.403061 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.403285 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.403434 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.403575 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.403728 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.403893 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404104 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404260 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404403 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404544 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404685 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404826 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.404966 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.405116 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.405274 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.405510 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.405670 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.405825 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.406000 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.406149 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.406321 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.406967 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407109 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407250 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407399 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407541 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407682 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407823 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.407963 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408113 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408264 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408406 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408546 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408687 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408828 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.408976 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.409128 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.409128 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.409405 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.409405 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.409672 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.409821 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410088 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410088 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410372 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410515 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410655 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410804 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.410947 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411088 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411228 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411375 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411517 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411671 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411821 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.411974 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412115 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412255 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412402 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412552 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412694 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412834 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.412974 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.413115 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.413286 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.413506 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.413653 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.413794 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.413967 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.414132 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.414354 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.414502 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.414642 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.414783 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.414922 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.415063 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.415213 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.415363 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.415521 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.415735 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.415882 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416041 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416194 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416336 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416477 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416616 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416756 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.416915 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417059 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417199 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417347 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417488 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417643 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417804 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.417971 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.418120 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.418262 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.418630 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.418779 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419002 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419146 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419294 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419447 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419589 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419729 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.419919 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.420087 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.420230 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.420469 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.420625 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.420899 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421088 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421232 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421372 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421514 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421654 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421803 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.421990 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.422139 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.422292 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.422433 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.422573 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.422730 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.422873 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423013 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423152 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423293 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423434 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423671 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423821 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.423962 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.424103 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.424254 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.424487 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.424644 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.424788 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.424936 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.425077 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.425218 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.425372 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.425520 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.425664 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.425885 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.426148 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.426148 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.426443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.426586 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.426728 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.426869 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427009 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427149 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427308 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427451 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427591 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427732 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.427872 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428019 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428172 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428315 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428455 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428596 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428744 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.428895 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.429037 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.429178 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.429318 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.429610 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.429756 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.429909 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430086 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430250 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430393 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430534 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430681 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430833 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.430974 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431115 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431256 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431404 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431554 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431696 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431836 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.431977 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432127 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432268 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432422 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432571 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432713 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432852 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.432993 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.433134 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.433283 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.433425 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.433566 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.433566 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.433926 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.434132 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.434287 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.434430 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.434654 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.434802 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.434944 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.435086 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.435235 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.435377 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.435525 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.435682 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.435825 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436066 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436217 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436358 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436498 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436498 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436765 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.436914 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.437056 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.437196 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.437343 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.437507 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.437714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.437947 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.438169 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.438169 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.438571 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.438775 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.438931 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.438931 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.439208 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.439208 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.439476 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.439624 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.439780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.439780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440056 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440208 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440355 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440496 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440496 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440772 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.440911 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441051 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441331 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441480 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441621 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441768 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.441768 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442116 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442269 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442427 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442570 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442709 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442849 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.442988 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.443141 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.443283 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.443423 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.443563 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.443716 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.443951 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.444113 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.444256 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.444256 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.444522 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.444679 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.444889 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445066 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445222 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445372 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445521 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445664 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445813 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.445988 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.446223 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.446223 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.446516 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.446659 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.446800 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.446947 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447237 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447389 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447532 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447673 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447834 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.447985 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448127 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448268 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448408 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448555 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448698 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448847 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.448996 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.449137 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.449278 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.449418 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.449559 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.449722 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.449866 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450036 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450190 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450331 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450472 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450655 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450808 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.450949 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451097 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451238 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451387 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451530 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451684 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451825 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.451973 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452123 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452274 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452274 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452550 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452692 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452692 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.452959 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.453633 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.453784 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.453993 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.454153 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.454296 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.454449 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.454599 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.454740 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.454898 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455111 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455258 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455408 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455551 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455691 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455691 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.455969 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.456111 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.456339 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.456489 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.456646 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.456851 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.457054 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.457054 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.457337 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.457479 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.457646 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.457828 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458003 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458216 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458360 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458502 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458642 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458783 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.458922 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459071 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459214 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459355 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459496 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459636 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459776 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459925 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.459925 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.460206 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.460347 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.460488 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.460635 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.460635 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.460920 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.461061 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.461061 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.461328 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.461623 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.461623 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.461901 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462082 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462082 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462364 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462518 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462518 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462785 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.462926 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463066 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463206 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463206 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463206 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463608 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463760 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.463900 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464041 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464041 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464317 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464458 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464598 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464746 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.464896 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.465132 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.465356 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.465506 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.465648 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.465801 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466003 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466154 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466325 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466325 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466600 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466741 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.466895 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467038 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467178 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467178 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467452 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467595 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467762 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.467947 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.468098 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.468340 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.468532 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.468691 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.469500 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.469849 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470023 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470168 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470310 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470467 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470627 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470771 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.470912 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471054 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471195 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471344 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471494 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471642 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471784 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.471932 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.472084 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.472226 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.472367 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.472524 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.472675 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.472822 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.473035 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.473179 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.473319 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.473460 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474052 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474205 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474360 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474502 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474655 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474809 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.474953 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.475103 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.475247 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.475481 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.475640 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.476623 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.476781 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.476935 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477080 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477221 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477372 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477527 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477677 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477677 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.477981 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478131 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478131 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478400 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478553 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478553 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478823 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478963 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.478963 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.479320 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.479489 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.479632 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.479956 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.479956 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.480238 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.480379 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.480530 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.480680 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.480829 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.480971 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481112 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481253 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481407 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481560 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481560 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481828 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.481993 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.482140 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.482295 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.482437 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.482602 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.482746 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.482886 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483036 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483179 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483331 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483472 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483612 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483753 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.483902 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.484045 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.484185 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.484340 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.484530 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.484702 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.484860 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.485035 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.485184 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.485346 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.485508 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.485732 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.485881 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.486124 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.486268 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.486410 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.486562 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.486717 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.486867 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487017 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487159 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487311 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487452 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487603 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487751 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.487896 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488036 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488176 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488325 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488468 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488609 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488750 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.488891 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.489046 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.489196 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.489339 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.489487 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.489634 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.489828 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490039 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490208 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490352 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490493 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490642 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490791 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.490942 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491095 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491246 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491393 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491535 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491676 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491825 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.491964 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492077 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492167 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492251 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492472 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492576 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492788 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.492889 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.493103 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.493202 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.493408 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.493499 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.493718 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.493925 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.494043 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.494262 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.494368 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.494599 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.494693 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.494921 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495021 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495244 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495343 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495562 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495651 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495874 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.495962 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.496256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.496365 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.496490 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.496578 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.496799 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.496900 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.497110 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.497212 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.497418 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.497506 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.497722 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.497817 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.498069 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.498176 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.498384 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.498560 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.498690 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.499372 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.499915 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500010 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500093 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500173 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500252 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500331 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500424 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500507 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500586 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500673 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500793 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.500891 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.501099 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.501188 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.501426 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.501516 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.502107 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.502623 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.502623 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.502775 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.502855 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.502933 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503013 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503172 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503336 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503422 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503502 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503589 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503679 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503843 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.503934 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.504152 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.504240 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.504460 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.504663 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.504773 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.504871 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.505062 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.505153 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.505367 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.505455 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.505677 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.505780 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506023 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506112 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506333 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506423 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506641 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506727 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.506957 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507063 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507261 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507357 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507572 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507679 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507874 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.507972 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.508181 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.508265 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.508490 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.508576 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.508793 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.508888 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.509104 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.509190 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.509408 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.509496 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.509709 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.509810 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.510121 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.510209 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.510437 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.510541 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.510763 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.510849 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.511083 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.511169 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.511392 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.511476 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.511700 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.511786 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512018 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512104 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512326 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512411 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512649 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512736 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.512955 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.513040 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.513266 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.513360 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.513610 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.513696 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.513925 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.514030 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.514273 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.514569 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.514667 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.514866 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.514954 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.515173 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.515314 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.515522 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.516275 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.516419 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.516638 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.516733 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.516940 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.517210 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.517301 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.517519 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.517652 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.517819 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.517973 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.518144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.518318 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.518446 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.518675 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.518821 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519043 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519135 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519344 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519439 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519647 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519770 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.519948 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.520140 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.520289 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.520508 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.520655 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.520834 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.520974 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.521140 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.521254 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.521443 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.521604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.521745 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522080 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522190 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522394 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522494 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522651 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522750 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.522984 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.523077 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.523319 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.523469 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.523640 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.523905 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.523999 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.524257 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.524350 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.524572 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.524671 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.524880 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.525015 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.525198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.525287 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.525518 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.525614 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.525831 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526004 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526169 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526325 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526500 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526642 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526810 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.526965 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.527121 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.527301 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.527432 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.527620 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.527712 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.527930 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.528025 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.528322 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.528416 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.528649 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.528736 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.528973 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.529059 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.529278 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.529387 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.529599 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.529686 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.529914 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530035 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530254 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530348 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530567 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530659 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530876 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.530968 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.531192 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.531881 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532049 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532144 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532363 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532464 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532683 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532780 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.532994 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.533081 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.533306 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.533392 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.533632 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.533721 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.533960 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534049 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534279 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534385 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534601 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534695 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534912 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.534998 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.535215 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.535312 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.535519 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.535605 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.535831 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.535918 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.536139 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.536236 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.536447 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.536543 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.536754 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.536846 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537060 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537154 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537458 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537672 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537759 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.537954 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103056) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 05:45:25.538055 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.538292 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.538597 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.538906 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.539209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.539520 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.539825 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.540131 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.540438 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.540744 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.541050 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.541383 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.541718 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.542067 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.542397 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.542717 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.543041 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.543354 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.543678 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.544000 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.544317 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.544630 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.544964 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.545280 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.545595 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.545910 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.546247 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.546561 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.546900 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.547234 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.547565 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.547877 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.548204 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.548525 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.548845 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.549162 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.549476 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.549806 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.550145 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.550459 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.550775 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.551090 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.551406 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.551725 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.552050 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.552377 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.552705 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.553018 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.553344 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.553673 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.554041 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.554360 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.554705 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.555034 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.555349 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.555665 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.555975 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:45:25.556220 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103055) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 05:45:25.693320 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO dbcounter [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Registered counter for database nova_api Jun 21 05:45:25.711666 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO dbcounter [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Registered counter for database nova_api Jun 21 05:45:25.715217 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_db.sqlalchemy.engines [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.722441 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writer thread running {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.732180 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_db.sqlalchemy.engines [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.738739 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writer thread running {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.780958 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.context [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e3921fb-c59b-4ca6-b53d-6a0f3973a431(cell1) {{(pid=103056) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 05:45:25.785254 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:45:25.786964 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:45:25.787746 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:45:25.789732 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:45:25.791832 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO dbcounter [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Registered counter for database nova_cell0 Jun 21 05:45:25.796026 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO dbcounter [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Registered counter for database nova_cell1 Jun 21 05:45:25.800503 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.context [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e3921fb-c59b-4ca6-b53d-6a0f3973a431(cell1) {{(pid=103055) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 05:45:25.803801 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_db.sqlalchemy.engines [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.804880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_concurrency.lockutils [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:45:25.805578 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_db.sqlalchemy.engines [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.807986 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_concurrency.lockutils [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=103055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:45:25.808829 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_concurrency.lockutils [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:45:25.810857 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_concurrency.lockutils [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103055) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:45:25.811187 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writer thread running {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.813438 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO dbcounter [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Registered counter for database nova_cell0 Jun 21 05:45:25.817063 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writer thread running {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.817511 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO dbcounter [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Registered counter for database nova_cell1 Jun 21 05:45:25.824533 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_db.sqlalchemy.engines [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.828059 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_db.sqlalchemy.engines [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.831291 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writer thread running {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.963172 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO dbcounter [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Registered counter for database nova_cell0 Jun 21 05:45:25.971844 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_db.sqlalchemy.engines [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103056) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.975489 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writer thread running {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.976419 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writer thread running {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:25.984436 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO dbcounter [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Registered counter for database nova_cell0 Jun 21 05:45:25.991141 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG oslo_db.sqlalchemy.engines [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103055) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:45:25.995468 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writer thread running {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:45:26.313737 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: WARNING keystonemiddleware.auth_token [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:45:26.319030 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: WARNING keystonemiddleware.auth_token [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:45:26.320982 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: WARNING keystonemiddleware.auth_token [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:45:26.326223 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: WARNING keystonemiddleware.auth_token [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:45:26.663672 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: WARNING keystonemiddleware.auth_token [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:45:26.669540 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: WARNING keystonemiddleware.auth_token [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:45:26.669658 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: WARNING keystonemiddleware.auth_token [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:45:26.674994 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ab78769c0 pid: 103056 (default app) Jun 21 05:45:26.675572 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: WARNING keystonemiddleware.auth_token [None req-586ea1ea-6bf9-4821-939f-c69eae524908 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:45:26.677096 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:45:26.678306 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] 10.222.0.18 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jun 21 05:45:26.678716 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 788 bytes} [Tue Jun 21 05:45:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:45:26.680881 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564ab78769c0 pid: 103055 (default app) Jun 21 05:46:42.206799 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:42.207896 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Jun 21 05:46:42.208460 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:42.227215 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writing DB stats nova_api:SELECT=3 {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:42.228234 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writing DB stats nova_cell0:SELECT=3 {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:42.229910 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writing DB stats nova_cell1:SELECT=3 {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:42.230884 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writing DB stats nova_cell0:SELECT=3 {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:42.683179 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-29c1b701-f566-403c-baba-2e5a551f4ff6 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:42.712782 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-29c1b701-f566-403c-baba-2e5a551f4ff6 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.497008 Jun 21 05:46:42.714665 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 1/3] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 21 05:46:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:46:44.810481 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:44.811483 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-e577d150-18c7-434d-b9fe-8064cc3c7bf5 None None] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 21 05:46:44.811906 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 3/4] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:44.873525 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-f731398b-c5c9-42b8-b1c2-6c2a289c92ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "ram": 256}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:44.892473 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:46:44.892473 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: warnings.warn(msg) Jun 21 05:46:44.923087 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-f731398b-c5c9-42b8-b1c2-6c2a289c92ca admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104864 Jun 21 05:46:44.923877 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 2/5] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:46:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:46:44.937291 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_api:SELECT=3 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:44.938610 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_cell1:SELECT=3 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:44.939890 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_cell0:SELECT=3 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:44.941038 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:46:45.147796 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-46187c27-761f-46b0-a86d-2168057354d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:45.150226 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:46:45.150226 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: warnings.warn(msg) Jun 21 05:46:45.222241 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-46187c27-761f-46b0-a86d-2168057354d0 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290237 Jun 21 05:46:45.222977 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 4/6] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 21 05:46:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:46:47.347415 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-f731398b-c5c9-42b8-b1c2-6c2a289c92ca admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:47.348357 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-f731398b-c5c9-42b8-b1c2-6c2a289c92ca admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 21 05:46:47.348769 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 3/7] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:47.455235 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-048c3923-887a-43b1-9322-52152781f2cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "id": "d1", "swap": 0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:47.473131 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:46:47.473131 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: warnings.warn(msg) Jun 21 05:46:47.491528 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-048c3923-887a-43b1-9322-52152781f2cd admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.135349 Jun 21 05:46:47.492079 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 5/8] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:46:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:46:47.504555 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-dd08cb98-b624-4b15-a538-2ea3f50c667a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:47.506028 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:46:47.506028 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: warnings.warn(msg) Jun 21 05:46:47.537225 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-dd08cb98-b624-4b15-a538-2ea3f50c667a admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036391 Jun 21 05:46:47.537797 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 4/9] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 21 05:46:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:46:49.668545 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-048c3923-887a-43b1-9322-52152781f2cd admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:49.669555 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-048c3923-887a-43b1-9322-52152781f2cd admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 21 05:46:49.669969 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:49.731300 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-7d957077-d516-4cd6-8b08-f8a86c928349 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:49.754920 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-7d957077-d516-4cd6-8b08-f8a86c928349 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079071 Jun 21 05:46:49.755959 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 5/11] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:46:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:46:49.768835 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-10fa46a4-67fd-47ff-a946-4bee576e4fa3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:49.791656 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-10fa46a4-67fd-47ff-a946-4bee576e4fa3 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026426 Jun 21 05:46:49.792318 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 7/12] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 21 05:46:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:46:51.894530 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-7d957077-d516-4cd6-8b08-f8a86c928349 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:51.895567 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-7d957077-d516-4cd6-8b08-f8a86c928349 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 21 05:46:51.895965 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 6/13] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:51.953802 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-ff08d379-0453-4efe-ae21-2efd3656da9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:51.971337 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-ff08d379-0453-4efe-ae21-2efd3656da9c admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.069629 Jun 21 05:46:51.971891 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 8/14] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:46:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:46:51.986463 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-560ca4dd-eef4-4315-aff0-0f6df50460e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:52.008828 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-560ca4dd-eef4-4315-aff0-0f6df50460e7 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027110 Jun 21 05:46:52.009403 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 7/15] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 21 05:46:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:46:54.101779 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-ff08d379-0453-4efe-ae21-2efd3656da9c admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:54.102823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-ff08d379-0453-4efe-ae21-2efd3656da9c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 21 05:46:54.103755 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 9/16] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:54.162008 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-25bcf9b0-3196-402b-9cc0-50035ee0c5c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "disk": 20, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:54.179645 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-25bcf9b0-3196-402b-9cc0-50035ee0c5c1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070134 Jun 21 05:46:54.180270 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 8/17] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:46:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:46:54.192583 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-51b6b29c-eb71-41e0-b578-8ff1562f7c52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:54.214476 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-51b6b29c-eb71-41e0-b578-8ff1562f7c52 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025541 Jun 21 05:46:54.215022 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 10/18] 10.222.0.18 () {64 vars in 1335 bytes} [Tue Jun 21 05:46:54 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:46:56.322525 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-25bcf9b0-3196-402b-9cc0-50035ee0c5c1 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:56.323546 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-25bcf9b0-3196-402b-9cc0-50035ee0c5c1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Jun 21 05:46:56.323959 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 9/19] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:56.385633 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-540f02eb-4f39-4c0e-8954-74c4e8b7b845 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:56.410248 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-540f02eb-4f39-4c0e-8954-74c4e8b7b845 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080123 Jun 21 05:46:56.410869 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 11/20] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 21 05:46:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:46:58.541130 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-25bcf9b0-3196-402b-9cc0-50035ee0c5c1 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:46:58.542206 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-25bcf9b0-3196-402b-9cc0-50035ee0c5c1 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 21 05:46:58.542612 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 10/21] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:46:58.604221 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-8d565ae2-9e0c-48cd-ab27-147b190b9692 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:58.623345 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-8d565ae2-9e0c-48cd-ab27-147b190b9692 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.074680 Jun 21 05:46:58.624128 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 12/22] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:46:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:46:58.636905 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-5a624348-56c0-48f4-bd7d-da190bb96786 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:46:58.662030 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-5a624348-56c0-48f4-bd7d-da190bb96786 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029747 Jun 21 05:46:58.662634 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 11/23] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 21 05:46:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:47:00.827707 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-8d565ae2-9e0c-48cd-ab27-147b190b9692 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:00.828437 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-8d565ae2-9e0c-48cd-ab27-147b190b9692 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001806 Jun 21 05:47:00.828965 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 13/24] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:00.890609 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-1bd27885-2b4d-45bc-b8b7-2c15a7be142f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "id": "2"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:00.908510 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-1bd27885-2b4d-45bc-b8b7-2c15a7be142f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072396 Jun 21 05:47:00.909057 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 12/25] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:47:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:47:00.924902 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-7e325d0d-04fb-45a5-ada2-59ee8851d0d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:00.948707 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-7e325d0d-04fb-45a5-ada2-59ee8851d0d1 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027443 Jun 21 05:47:00.949280 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 14/26] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 21 05:47:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:47:03.105694 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-1bd27885-2b4d-45bc-b8b7-2c15a7be142f admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:03.106779 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-1bd27885-2b4d-45bc-b8b7-2c15a7be142f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 21 05:47:03.107190 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 13/27] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:03.169514 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-0163588d-a7b6-4d0e-8e4f-08bdd1618472 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:03.192699 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-0163588d-a7b6-4d0e-8e4f-08bdd1618472 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079386 Jun 21 05:47:03.193414 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 15/28] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:47:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:47:03.205159 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-d6d90489-9beb-4ff0-8426-228256baaf87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:03.232087 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-d6d90489-9beb-4ff0-8426-228256baaf87 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030482 Jun 21 05:47:03.239529 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 14/29] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 21 05:47:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:47:05.321545 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-0163588d-a7b6-4d0e-8e4f-08bdd1618472 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:05.322669 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-0163588d-a7b6-4d0e-8e4f-08bdd1618472 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jun 21 05:47:05.323060 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 16/30] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:47:05.384497 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ad3a0a6d-4074-4714-8844-8d3db4b6803f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "id": "4"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:05.404098 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-ad3a0a6d-4074-4714-8844-8d3db4b6803f admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074958 Jun 21 05:47:05.405328 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 15/31] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:47:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:47:05.417459 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-65be0429-1ed6-4be6-9e97-ccc4bf63c211 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:05.443317 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-65be0429-1ed6-4be6-9e97-ccc4bf63c211 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030443 Jun 21 05:47:05.444067 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 17/32] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 21 05:47:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:47:07.554859 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ad3a0a6d-4074-4714-8844-8d3db4b6803f admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:07.556451 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-ad3a0a6d-4074-4714-8844-8d3db4b6803f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002165 Jun 21 05:47:07.556993 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 16/33] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:47:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:07.620014 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-4c395226-6ea6-4739-a597-a74872342668 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:07.638936 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-4c395226-6ea6-4739-a597-a74872342668 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075429 Jun 21 05:47:07.639481 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 18/34] 10.222.0.18 () {64 vars in 1282 bytes} [Tue Jun 21 05:47:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:47:07.652464 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-de38087c-64f3-4962-bcc8-884364cf3296 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:07.678591 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-de38087c-64f3-4962-bcc8-884364cf3296 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030324 Jun 21 05:47:07.679189 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 17/35] 10.222.0.18 () {64 vars in 1332 bytes} [Tue Jun 21 05:47:07 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:47:32.506993 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-4c395226-6ea6-4739-a597-a74872342668 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:32.507993 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-4c395226-6ea6-4739-a597-a74872342668 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 21 05:47:32.508384 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 19/36] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:32.518642 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:32.566449 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ab73b12f-46d5-441e-a785-17eb7a6a6dc8 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:32.583121 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-ab73b12f-46d5-441e-a785-17eb7a6a6dc8 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068979 Jun 21 05:47:32.583648 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 18/37] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 21 05:47:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:47:33.504038 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-4c395226-6ea6-4739-a597-a74872342668 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:33.505033 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-4c395226-6ea6-4739-a597-a74872342668 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 21 05:47:33.505426 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 20/38] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:33.694461 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-f6ab7c85-4a82-4de6-bf07-45df4ea54e73 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:33.699959 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.wsgi [None req-f6ab7c85-4a82-4de6-bf07-45df4ea54e73 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-f6ab7c85-4a82-4de6-bf07-45df4ea54e73 admin admin] Request method failure captured: Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Accept: application/json Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Accept-Encoding: gzip, deflate Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Connection: keep-alive Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Content-Length: 0 Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Host: 10.222.0.18 Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Openstack-Api-Version: compute 2.90 Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Openstack-System-Scope: None Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: User-Agent: python-novaclient Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Auth-Token: gAAAAABisVt1JwH0daLguszvjSweYdqzPhwddpkr3dwxWCEgUIMyviHi7LTbSWJvVvE34Zo_PwZ7O1l8JpoSlyRwzydgh1uS4K0-1Z-oGe3HWebltxVZUbnwMsX5gyJlUSuvtMtp2ykuOzKaTQkbeM6zjJ_Lp7NuhdKwCtb4dURTEP7-heDPJho Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Domain-Id: None Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Domain-Name: None Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Identity-Status: Confirmed Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Is-Admin-Project: True Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Domain-Id: default Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Domain-Name: Default Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Name: admin Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Role: admin,reader,member Jun 21 05:47:33.704089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Roles: admin,reader,member Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant: admin Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant-Name: admin Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User: admin Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Domain-Id: default Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Domain-Name: Default Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Id: 79f991743edf4c82841603b9b9845e95 Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Name: admin Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: method: > Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: exception: Flavor 42 could not be found. Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: action_args: {'id': '42'} Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:47:33.705604 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:33.706714 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.708160 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-f6ab7c85-4a82-4de6-bf07-45df4ea54e73 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:47:33.709465 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-f6ab7c85-4a82-4de6-bf07-45df4ea54e73 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062376 Jun 21 05:47:33.709465 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 19/39] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 21 05:47:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:33.715045 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-7667494b-7ca2-4d2b-a70a-c1a6e6f058cc admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:33.717952 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:47:33.739146 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-7667494b-7ca2-4d2b-a70a-c1a6e6f058cc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027690 Jun 21 05:47:33.739701 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 21/40] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 21 05:47:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:47:33.753251 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-1e7c1edb-10a1-497c-990e-95728d0b83d2 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:33.776021 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-1e7c1edb-10a1-497c-990e-95728d0b83d2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029585 Jun 21 05:47:33.776584 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 20/41] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 21 05:47:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:47:33.787054 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-e0518b68-45ff-4ef8-b275-952f7e1b9a5d admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:33.796025 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.wsgi [None req-e0518b68-45ff-4ef8-b275-952f7e1b9a5d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-e0518b68-45ff-4ef8-b275-952f7e1b9a5d admin admin] Request method failure captured: Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Accept: application/json Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Accept-Encoding: gzip, deflate Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Connection: keep-alive Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Content-Length: 0 Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Host: 10.222.0.18 Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Openstack-Api-Version: compute 2.90 Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Openstack-System-Scope: None Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: User-Agent: python-novaclient Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Auth-Token: gAAAAABisVt1JwH0daLguszvjSweYdqzPhwddpkr3dwxWCEgUIMyviHi7LTbSWJvVvE34Zo_PwZ7O1l8JpoSlyRwzydgh1uS4K0-1Z-oGe3HWebltxVZUbnwMsX5gyJlUSuvtMtp2ykuOzKaTQkbeM6zjJ_Lp7NuhdKwCtb4dURTEP7-heDPJho Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Domain-Id: None Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Domain-Name: None Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Identity-Status: Confirmed Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Is-Admin-Project: True Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Domain-Id: default Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Domain-Name: Default Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Name: admin Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Role: admin,reader,member Jun 21 05:47:33.799298 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Roles: admin,reader,member Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant: admin Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant-Name: admin Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User: admin Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Domain-Id: default Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Domain-Name: Default Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Id: 79f991743edf4c82841603b9b9845e95 Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Name: admin Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: method: > Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: exception: Flavor 42 could not be found. Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: action_args: {'id': '42'} Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:47:33.800856 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:33.801823 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:33.803093 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-e0518b68-45ff-4ef8-b275-952f7e1b9a5d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:47:33.804297 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-e0518b68-45ff-4ef8-b275-952f7e1b9a5d admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018170 Jun 21 05:47:33.804297 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 22/42] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 21 05:47:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:34.608756 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-1e7c1edb-10a1-497c-990e-95728d0b83d2 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:34.609767 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-1e7c1edb-10a1-497c-990e-95728d0b83d2 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 21 05:47:34.610193 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 21/43] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:34.801554 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-1738859f-9cc0-4a60-a2b9-c734064189fc admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:34.809621 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.wsgi [None req-1738859f-9cc0-4a60-a2b9-c734064189fc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-1738859f-9cc0-4a60-a2b9-c734064189fc admin admin] Request method failure captured: Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Accept: application/json Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Accept-Encoding: gzip, deflate Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Connection: keep-alive Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Content-Length: 0 Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Host: 10.222.0.18 Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Openstack-Api-Version: compute 2.90 Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Openstack-System-Scope: None Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: User-Agent: python-novaclient Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Auth-Token: gAAAAABisVt2oYQaOJUvh-bwXtgkOSWO5G9kyjNG4lE2Q8LgEwDozOfffOEwCkEQvLrXUcPJM3JTzAdoToO032NsPVWEfPKovYAXvmtRPJ5mwnvRJUiwE5xx032CdED4UYwMgaXmN0ZBbL5lI1IuUT13r4LFlnAEwzTzF9pDF-5iELYFLsIRc_A Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Domain-Id: None Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Domain-Name: None Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Identity-Status: Confirmed Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Is-Admin-Project: True Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Domain-Id: default Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Domain-Name: Default Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Name: admin Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Role: admin,reader,member Jun 21 05:47:34.811144 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Roles: admin,reader,member Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant: admin Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant-Name: admin Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User: admin Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Domain-Id: default Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Domain-Name: Default Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Id: 79f991743edf4c82841603b9b9845e95 Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Name: admin Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: method: > Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: exception: Flavor 84 could not be found. Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: action_args: {'id': '84'} Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:47:34.812780 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:34.813882 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.815279 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-1738859f-9cc0-4a60-a2b9-c734064189fc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:47:34.816572 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-1738859f-9cc0-4a60-a2b9-c734064189fc admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.063923 Jun 21 05:47:34.816572 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 21 05:47:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:34.822894 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ea0a7ef8-f380-48a6-96e8-da2594d0844f admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:34.838070 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-ea0a7ef8-f380-48a6-96e8-da2594d0844f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019348 Jun 21 05:47:34.838617 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 22/45] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 21 05:47:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:47:34.848203 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-7c818dbe-997d-4dbd-b31e-454c8a4a9a1f admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:34.861763 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-7c818dbe-997d-4dbd-b31e-454c8a4a9a1f admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017261 Jun 21 05:47:34.862305 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 24/46] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 21 05:47:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:47:34.871819 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-70db8be2-a8fa-4a04-a452-7ca314dab01a admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:34.877349 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.wsgi [None req-70db8be2-a8fa-4a04-a452-7ca314dab01a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-70db8be2-a8fa-4a04-a452-7ca314dab01a admin admin] Request method failure captured: Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Accept: application/json Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Accept-Encoding: gzip, deflate Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Connection: keep-alive Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Content-Length: 0 Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Host: 10.222.0.18 Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Openstack-Api-Version: compute 2.90 Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Openstack-System-Scope: None Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: User-Agent: python-novaclient Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Auth-Token: gAAAAABisVt2oYQaOJUvh-bwXtgkOSWO5G9kyjNG4lE2Q8LgEwDozOfffOEwCkEQvLrXUcPJM3JTzAdoToO032NsPVWEfPKovYAXvmtRPJ5mwnvRJUiwE5xx032CdED4UYwMgaXmN0ZBbL5lI1IuUT13r4LFlnAEwzTzF9pDF-5iELYFLsIRc_A Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Domain-Id: None Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Domain-Name: None Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Identity-Status: Confirmed Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Is-Admin-Project: True Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Domain-Id: default Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Domain-Name: Default Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Name: admin Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Role: admin,reader,member Jun 21 05:47:34.878880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Roles: admin,reader,member Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant: admin Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant-Name: admin Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User: admin Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Domain-Id: default Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Domain-Name: Default Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Id: 79f991743edf4c82841603b9b9845e95 Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Name: admin Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: method: > Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: exception: Flavor 84 could not be found. Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: action_args: {'id': '84'} Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:47:34.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:34.881629 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:34.883209 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-70db8be2-a8fa-4a04-a452-7ca314dab01a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:47:34.884585 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-70db8be2-a8fa-4a04-a452-7ca314dab01a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012597 Jun 21 05:47:34.884585 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 23/47] 10.222.0.18 () {60 vars in 1190 bytes} [Tue Jun 21 05:47:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:35.689907 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-7c818dbe-997d-4dbd-b31e-454c8a4a9a1f admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:35.690953 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-7c818dbe-997d-4dbd-b31e-454c8a4a9a1f admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 21 05:47:35.691347 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 25/48] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:35.882060 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ee283d10-cd12-4106-8913-4a03bd361f39 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:35.888308 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.wsgi [None req-ee283d10-cd12-4106-8913-4a03bd361f39 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ee283d10-cd12-4106-8913-4a03bd361f39 admin admin] Request method failure captured: Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Accept: application/json Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Accept-Encoding: gzip, deflate Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Connection: keep-alive Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Content-Length: 0 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Host: 10.222.0.18 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Openstack-Api-Version: compute 2.90 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Openstack-System-Scope: None Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: User-Agent: python-novaclient Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Auth-Token: gAAAAABisVt3zkvRkqPQOV3X3bBa3sCMmxe9VroXfCkB6Dn973eOjqeCl9J93bhkaSHRALj4ip8xkoXoP9G9Yzczst7I7TJMW8oCMqIbWtscuAkerNKc0wS5esoFHeIjr-ryJcaFRmVudJoavhb1r-oy7edccWaoE2LD4XMXfYeUiMDHaz2-k-4 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Domain-Id: None Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Domain-Name: None Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Identity-Status: Confirmed Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Is-Admin-Project: True Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Domain-Id: default Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Domain-Name: Default Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Project-Name: admin Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Role: admin,reader,member Jun 21 05:47:35.889811 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Roles: admin,reader,member Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant: admin Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-Tenant-Name: admin Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User: admin Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Domain-Id: default Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Domain-Name: Default Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Id: 79f991743edf4c82841603b9b9845e95 Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: X-User-Name: admin Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: method: > Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: exception: Flavor 451 could not be found. Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: action_args: {'id': '451'} Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:47:35.891369 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:35.892391 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.893752 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-ee283d10-cd12-4106-8913-4a03bd361f39 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103055) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:47:35.895006 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-ee283d10-cd12-4106-8913-4a03bd361f39 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061055 Jun 21 05:47:35.895006 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 24/49] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 21 05:47:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:35.901292 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-14559a47-e7ea-47e6-91c4-efe8ba401ffb admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:35.922859 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-14559a47-e7ea-47e6-91c4-efe8ba401ffb admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025684 Jun 21 05:47:35.923389 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 26/50] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 21 05:47:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:47:35.932669 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:35.946040 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016844 Jun 21 05:47:35.946555 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 25/51] 10.222.0.18 () {60 vars in 1210 bytes} [Tue Jun 21 05:47:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:47:35.956008 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-fe9946ea-bfab-4390-8728-f118b129882c admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:35.961396 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.wsgi [None req-fe9946ea-bfab-4390-8728-f118b129882c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-fe9946ea-bfab-4390-8728-f118b129882c admin admin] Request method failure captured: Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Accept: application/json Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Accept-Encoding: gzip, deflate Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Connection: keep-alive Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Content-Length: 0 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Host: 10.222.0.18 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Openstack-Api-Version: compute 2.90 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Openstack-System-Scope: None Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: User-Agent: python-novaclient Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Auth-Token: gAAAAABisVt3zkvRkqPQOV3X3bBa3sCMmxe9VroXfCkB6Dn973eOjqeCl9J93bhkaSHRALj4ip8xkoXoP9G9Yzczst7I7TJMW8oCMqIbWtscuAkerNKc0wS5esoFHeIjr-ryJcaFRmVudJoavhb1r-oy7edccWaoE2LD4XMXfYeUiMDHaz2-k-4 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Domain-Id: None Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Domain-Name: None Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Identity-Status: Confirmed Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Is-Admin-Project: True Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Openstack-Nova-Api-Version: 2.90 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Domain-Id: default Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Domain-Name: Default Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Project-Name: admin Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Role: admin,reader,member Jun 21 05:47:35.963540 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Roles: admin,reader,member Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/fcf1eaa475624717b45bb4aefba5ae51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant: admin Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant-Id: fcf1eaa475624717b45bb4aefba5ae51 Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-Tenant-Name: admin Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User: admin Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Domain-Id: default Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Domain-Name: Default Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Id: 79f991743edf4c82841603b9b9845e95 Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: X-User-Name: admin Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: method: > Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: exception: Flavor 451 could not be found. Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: action_args: {'id': '451'} Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:47:35.965191 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:35.966198 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: ERROR nova.api.openstack.wsgi Jun 21 05:47:35.967256 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-fe9946ea-bfab-4390-8728-f118b129882c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103056) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:47:35.968308 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-fe9946ea-bfab-4390-8728-f118b129882c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012348 Jun 21 05:47:35.968308 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 27/52] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 21 05:47:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 21 05:47:36.785411 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:36.786532 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jun 21 05:47:36.786922 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:36.977547 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-12c27f74-0815-494c-b1d4-ed2988f02963 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:36.995649 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-12c27f74-0815-494c-b1d4-ed2988f02963 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.071557 Jun 21 05:47:36.996117 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 28/54] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 21 05:47:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:47:37.823385 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:37.824386 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 21 05:47:37.824780 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:38.014170 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-edbaefe3-283a-44b7-aa0e-ba3c7280f345 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:38.032063 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-edbaefe3-283a-44b7-aa0e-ba3c7280f345 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070418 Jun 21 05:47:38.032511 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 29/56] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 21 05:47:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:47:38.863504 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:38.864509 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 21 05:47:38.864909 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 28/57] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:39.054733 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-3483c8c0-7d06-4ca9-b5c6-d0bb78e82630 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:39.073955 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-3483c8c0-7d06-4ca9-b5c6-d0bb78e82630 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070677 Jun 21 05:47:39.074421 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 30/58] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 21 05:47:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:47:39.896089 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:39.897101 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 21 05:47:39.897498 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 29/59] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:40.084040 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-5cdd921d-5007-4c94-b64a-82b64c264725 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:47:40.102384 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-5cdd921d-5007-4c94-b64a-82b64c264725 admin admin] 10.222.0.18 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069126 Jun 21 05:47:40.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 31/60] 10.222.0.18 () {64 vars in 1235 bytes} [Tue Jun 21 05:47:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:47:40.923741 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:40.924747 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 21 05:47:40.925142 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 30/61] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:47:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:47:41.112023 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-28e5d84e-d1f9-4135-8cc6-a626fae69ff2 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:47:41.131659 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-28e5d84e-d1f9-4135-8cc6-a626fae69ff2 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071566 Jun 21 05:47:41.132193 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 32/62] 10.222.0.18 () {60 vars in 1202 bytes} [Tue Jun 21 05:47:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:48:28.070127 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:48:28.071290 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-604193a3-a25e-45f8-bfaa-59fd0b463710 admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001810 Jun 21 05:48:28.071734 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 31/63] 10.222.0.18 () {54 vars in 930 bytes} [Tue Jun 21 05:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:48:28.083529 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:48:28.156940 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-ce7219e2-fde9-45c6-9542-1ca8e852da25 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:48:28.176449 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-ce7219e2-fde9-45c6-9542-1ca8e852da25 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.097296 Jun 21 05:48:28.177016 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 33/64] 10.222.0.18 () {60 vars in 1291 bytes} [Tue Jun 21 05:48:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:48:28.200880 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-a3283b40-dca3-4f0c-8e90-371a469b144a admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:48:28.204377 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG dbcounter [-] [103055] Writing DB stats nova_api:SELECT=14 {{(pid=103055) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:48:28.212312 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-a3283b40-dca3-4f0c-8e90-371a469b144a admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014034 Jun 21 05:48:28.213085 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 32/65] 10.222.0.18 () {60 vars in 1282 bytes} [Tue Jun 21 05:48:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:48:28.226381 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-cb2ac724-1039-432b-90a0-38d381f12772 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:48:28.234361 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-cb2ac724-1039-432b-90a0-38d381f12772 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011754 Jun 21 05:48:28.234904 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 34/66] 10.222.0.18 () {60 vars in 1285 bytes} [Tue Jun 21 05:48:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:48:28.247749 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:48:28.256112 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012606 Jun 21 05:48:28.256681 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 33/67] 10.222.0.18 () {60 vars in 1285 bytes} [Tue Jun 21 05:48:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:48:28.269506 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-85f71f84-7bee-4dab-a907-1b2d408b61f4 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:48:28.278700 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-85f71f84-7bee-4dab-a907-1b2d408b61f4 admin admin] 10.222.0.18 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012749 Jun 21 05:48:28.279659 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 35/68] 10.222.0.18 () {60 vars in 1282 bytes} [Tue Jun 21 05:48:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:51:50.469026 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:51:50.470802 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002462 Jun 21 05:51:50.471527 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 34/69] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:51:50.629072 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_api:SELECT=6 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:51:50.750462 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-0ad5f758-bb67-46a0-b33e-2cfd1fc332ee admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:51:50.751685 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:51:50.751685 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: warnings.warn(msg) Jun 21 05:51:50.753223 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-0ad5f758-bb67-46a0-b33e-2cfd1fc332ee admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:51:50.753404 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-0ad5f758-bb67-46a0-b33e-2cfd1fc332ee admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:51:50.755095 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-0ad5f758-bb67-46a0-b33e-2cfd1fc332ee admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:51:50.755095 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-0ad5f758-bb67-46a0-b33e-2cfd1fc332ee admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:51:50.789310 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-0ad5f758-bb67-46a0-b33e-2cfd1fc332ee admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161607 Jun 21 05:51:50.789886 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 36/70] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 21 05:51:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:51:51.642045 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:51:51.643051 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 21 05:51:51.643444 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:51:51.838534 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-70bcb4af-9c26-4880-b60f-8abdbd5b2554 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:51:51.839711 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:51:51.839711 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: warnings.warn(msg) Jun 21 05:51:51.840900 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-70bcb4af-9c26-4880-b60f-8abdbd5b2554 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:51:51.841339 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-70bcb4af-9c26-4880-b60f-8abdbd5b2554 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:51:51.842155 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-70bcb4af-9c26-4880-b60f-8abdbd5b2554 admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:51:51.842592 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-70bcb4af-9c26-4880-b60f-8abdbd5b2554 admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:51:51.862055 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-70bcb4af-9c26-4880-b60f-8abdbd5b2554 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078552 Jun 21 05:51:51.862635 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 37/72] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 21 05:51:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:52:03.145186 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:52:03.146916 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Jun 21 05:52:03.147439 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 36/73] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:52:03.293296 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_cell0:SELECT=4 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:52:03.294054 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_cell1:SELECT=4 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:52:03.294667 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG dbcounter [-] [103056] Writing DB stats nova_api:SELECT=8 {{(pid=103056) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:52:03.345958 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-5f0913fd-c4dd-4ddc-b775-3ea67c4abb48 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:52:03.347208 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:52:03.347208 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: warnings.warn(msg) Jun 21 05:52:03.348726 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-5f0913fd-c4dd-4ddc-b775-3ea67c4abb48 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:52:03.349292 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-5f0913fd-c4dd-4ddc-b775-3ea67c4abb48 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:52:03.350225 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-5f0913fd-c4dd-4ddc-b775-3ea67c4abb48 admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:52:03.350758 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-5f0913fd-c4dd-4ddc-b775-3ea67c4abb48 admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:52:03.376533 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-5f0913fd-c4dd-4ddc-b775-3ea67c4abb48 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087721 Jun 21 05:52:03.377109 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 38/74] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 21 05:52:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:52:04.235296 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: DEBUG nova.api.openstack.wsgi [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] Calling method '>' {{(pid=103055) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:52:04.236297 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: INFO nova.api.openstack.requestlog [None req-88d2c0c8-5bb7-4d45-adb8-cf17c58c869c admin admin] 10.222.0.18 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 21 05:52:04.236690 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: [pid: 103055|app: 0|req: 37/75] 10.222.0.18 () {56 vars in 1074 bytes} [Tue Jun 21 05:52:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:52:04.440130 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG nova.api.openstack.wsgi [None req-8d1b5a34-2638-45a1-8668-f5155f306da8 admin admin] Calling method '>' {{(pid=103056) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:52:04.441338 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 05:52:04.441338 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: warnings.warn(msg) Jun 21 05:52:04.443123 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-8d1b5a34-2638-45a1-8668-f5155f306da8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:52:04.443675 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-8d1b5a34-2638-45a1-8668-f5155f306da8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:52:04.444802 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-8d1b5a34-2638-45a1-8668-f5155f306da8 admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:52:04.445508 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: DEBUG oslo_concurrency.lockutils [None req-8d1b5a34-2638-45a1-8668-f5155f306da8 admin admin] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103056) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:52:04.467884 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: INFO nova.api.openstack.requestlog [None req-8d1b5a34-2638-45a1-8668-f5155f306da8 admin admin] 10.222.0.18 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090446 Jun 21 05:52:04.468467 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: [pid: 103056|app: 0|req: 39/76] 10.222.0.18 () {60 vars in 1193 bytes} [Tue Jun 21 05:52:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:53:00.194566 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: Tue Jun 21 05:53:00 2022 - graceful shutdown triggered... Jun 21 05:53:00.195083 dv-cinder-846901-1-iscsi devstack@n-api.service[103056]: Gracefully killing worker 2 (pid: 103056)... Jun 21 05:53:00.195477 dv-cinder-846901-1-iscsi devstack@n-api.service[103055]: Gracefully killing worker 1 (pid: 103055)... Jun 21 05:53:00.198312 dv-cinder-846901-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 21 05:53:01.195723 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: worker 1 buried after 1 seconds Jun 21 05:53:01.196305 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: worker 2 buried after 1 seconds Jun 21 05:53:01.196305 dv-cinder-846901-1-iscsi devstack@n-api.service[103054]: goodbye to uWSGI. Jun 21 05:53:01.197288 dv-cinder-846901-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 21 05:53:01.197847 dv-cinder-846901-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 21 05:53:01.200632 dv-cinder-846901-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 21 05:53:01.211894 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 05:53:01 2022] *** Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: nodename: dv-cinder-846901-1-iscsi Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: machine: x86_64 Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: clock source: unix Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: pcre jit disabled Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: detected number of CPU cores: 4 Jun 21 05:53:01.213914 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: current working directory: / Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: detected binary path: /usr/bin/uwsgi-core Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: your processes number limit is 47680 Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: your memory page size is 4096 bytes Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: detected max file descriptor number: 2048 Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: lock engine: pthread robust mutexes Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: thunder lock: enabled Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 21 05:53:01.214684 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 05:53:01.261884 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: Python main interpreter initialized at 0x55f838aaa9c0 Jun 21 05:53:01.261884 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: python threads support enabled Jun 21 05:53:01.261884 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: your server socket listen backlog is limited to 100 connections Jun 21 05:53:01.261884 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: your mercy for graceful operations on workers is 90 seconds Jun 21 05:53:01.262431 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 05:53:01.262431 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: *** Operational MODE: preforking *** Jun 21 05:53:01.262677 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: *** uWSGI is running in multiple interpreter mode *** Jun 21 05:53:01.262677 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: spawned uWSGI master process (pid: 117417) Jun 21 05:53:01.262885 dv-cinder-846901-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 21 05:53:01.266132 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: spawned uWSGI worker 1 (pid: 117430, cores: 1) Jun 21 05:53:01.266132 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: spawned uWSGI worker 2 (pid: 117431, cores: 1) Jun 21 05:53:01.266132 dv-cinder-846901-1-iscsi devstack@n-api.service[117417]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 05:53:01.945008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 05:53:01.962561 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 21 05:53:03.162247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:53:03.162247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: from cryptography.utils import int_from_bytes Jun 21 05:53:03.162881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:53:03.162881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: from cryptography.utils import int_from_bytes Jun 21 05:53:03.243417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:53:03.243417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: from cryptography.utils import int_from_bytes Jun 21 05:53:03.244096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 05:53:03.244096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: from cryptography.utils import int_from_bytes Jun 21 05:53:05.679031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 05:53:05.679777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 05:53:05.679876 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 05:53:05.680213 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 05:53:05.680473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 05:53:05.680876 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.681215 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.681537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.681857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.682221 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.682554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.682860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.683179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.683509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.683772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.684087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.684413 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846901-1-iscsi {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.684742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.685052 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.685364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.685685 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.686094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.686422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.686728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.687237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.687689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.687994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.688308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.688644 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.688964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.689271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.689594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.689902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.690259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.691127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.691548 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846901-1-iscsi {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.691941 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.692199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.692516 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.692923 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.696756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697781 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.697781 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.698046 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.699212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.699212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.699212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.699212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.699782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.699782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.700080 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.700399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.700695 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.701004 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.701316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.701620 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.701925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.702250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.702559 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.702874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.703185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.703504 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.703808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.704127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.704531 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.704781 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.705089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.705387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 05:53:05.705814 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.705904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 05:53:05.706055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.706055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.706242 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 05:53:05.706401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.706609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 05:53:05.706710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.706868 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 05:53:05.707005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.707258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.707357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.707588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.707689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.707910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708021 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708228 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708533 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.708895 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.709087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.709187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.709393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.709501 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.709711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.709811 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710040 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710442 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710655 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846901-1-iscsi {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.710954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711047 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711359 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711569 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.711976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.712180 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.712274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.712484 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.712596 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.712786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.712890 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.713092 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.713292 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.713407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.713604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.713708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.713912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714596 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714694 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714906 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.714999 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.715211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.715305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.715517 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.715612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.715826 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846901-1-iscsi {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.716962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.717187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.717279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.717500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.717592 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.717815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.717983 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719006 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719136 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719614 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719701 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719784 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.719960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720230 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720313 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.720812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.721042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.721135 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.721347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.721453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.721658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.721761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722823 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.722978 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.723123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.723268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.723425 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.723576 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.723730 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.723873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.724023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.724175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.724325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.724473 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.724612 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.724773 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.724924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.725080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.725168 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.725266 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.725706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.725867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.726055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.726187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.730074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.730166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.730251 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.730334 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.730420 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.730505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.730587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.730661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.730732 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.730811 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.730897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.730982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.731145 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731216 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.731299 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.731458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.731614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.731772 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731845 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.731916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.731987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.732066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.18 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.732146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.732250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.18 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.732331 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.732436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.732521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.732634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.732727 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.732923 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.733009 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.733091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.733171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.733286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.733364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.733466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.733553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.733635 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.733716 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.733789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.733924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.734067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.734139 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.734223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.734297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.734377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.734458 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.734540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.734540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.734686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.734766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.734845 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.734934 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.735015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.735275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.735368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.735561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.735664 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.735874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.736014 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.736178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.736278 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.736483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.736660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.736801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.736892 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.737099 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.737202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.738483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.738797 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.738895 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.738999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.739087 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.739171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.739257 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.739355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.739451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.739536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.739620 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.739711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.739791 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.739878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.740055 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.740159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.740372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.740464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.740676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.740779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.740979 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.741081 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.741287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.741389 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.741585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.741680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.741910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.742111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.742266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.742428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.742567 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.743012 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.743172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.743315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.743406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.743543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.743624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.743697 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.743778 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.743987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.744098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.744297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.744482 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.744608 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.744711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.744930 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.745070 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.745261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.745519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.745613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.745897 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.746025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.746202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.746385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.746546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.746695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.746840 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.746984 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.747154 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.747306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.747460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.747616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.747760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.747917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.748069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.748212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.748361 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.748513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.748665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.748821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.748973 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.749139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.749282 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.749427 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.749569 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.749719 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.749870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.750066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.750208 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.750359 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.750504 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.750659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.750763 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.750884 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 05:53:05.751071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.751218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.751368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.751520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.751682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.751834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.751976 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.752117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.752264 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.752406 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.752570 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.752730 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.752877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.753597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.753755 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.753907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.754131 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.754273 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.754423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.754580 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.754724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.754867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755460 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755602 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.755894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756497 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756650 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.756965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.757106 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.757258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.757411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.757593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.757730 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.757917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.758188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.758332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.758480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.758622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.758762 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.758911 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759068 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759209 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.759951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760240 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760841 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.760992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.761134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.761290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.761437 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.761585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.761735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.761883 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762077 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762167 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762351 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762482 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.762996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.763099 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.763313 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.763422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.763628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.763722 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.763943 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.764052 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.764261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.764364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.764599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.764694 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.764917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765228 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765845 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.765959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.766179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.766282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.766494 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.766586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.766802 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.766893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.767108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.767214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.767416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.767508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.767723 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.767862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.768034 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.768342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769018 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769289 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769372 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.769765 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.770220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.770378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.770495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.770615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.770780 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.770980 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.771173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.771376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.771555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.771751 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.771920 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.772086 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.772086 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.772400 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.772703 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.773012 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.773172 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.773340 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.773507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.773678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.773825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.774018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.774189 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.774347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.774520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.774692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.774847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.775972 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.776125 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.776257 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.776407 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.776539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.776661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.776853 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.777056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.777188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.777419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.777729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.778060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.778388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.778693 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.779000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.779304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.779480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.779613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.779941 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.780253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.780358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.780560 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.780705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.780877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.781071 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.781200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.781426 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.781529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.781757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.781867 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.782145 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.782262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.782456 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.782560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.782780 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.782875 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.783087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.783181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.783401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.783508 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.783710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.783805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784020 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784360 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.784985 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.785088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.785292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.785385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.785602 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.785695 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.785911 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786065 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.786994 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.787181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.787456 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.787562 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.787787 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.787888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.788104 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.788203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.788426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.788521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.788749 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.788853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.789074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.789247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.789402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.789550 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.789726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.789971 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.790079 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.790167 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.790392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.790569 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.790720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.790872 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791174 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791475 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791906 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.791995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.792194 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.792338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.792488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.792638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.792796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.792945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.793102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.793242 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.793414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.793548 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.793687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.793843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794051 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794769 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.794945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.795088 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.795237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.795378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.795517 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.795691 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.795838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796010 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796315 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796462 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796599 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.796929 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.797068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.797233 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.797390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.797552 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.797701 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.797876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798009 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798222 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798543 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798635 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798848 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.798943 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.799175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.799340 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.799479 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.799575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.799783 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.800436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.800629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.800803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.801147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.801313 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.801455 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.801600 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.801795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.801885 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802004 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802530 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.802843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.803131 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.803973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.803973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804157 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804232 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804652 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.804968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.805120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.805281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.805432 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.805594 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.805739 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.805910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.806081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.806250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.806395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.806561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.806702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.806869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807083 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807319 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807639 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807814 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.807947 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.808139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.808244 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.808467 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.808560 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.808777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.808879 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.809085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.809179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.809412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.809519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.809721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.809825 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.810060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.810245 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.810416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.810578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.810737 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.810888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.811062 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.811221 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.811379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.811534 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.811691 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.811846 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.812005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.812170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.812418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.812579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.812733 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.812895 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.813040 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.813878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.814086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.814237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.814392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.814594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.814594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.814932 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.815079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.815233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.815388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.816177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.816414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.816584 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.816731 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.817256 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.817412 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.817569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.817726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.817886 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.818147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.818306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.818473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.818628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.818775 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.818920 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819085 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819232 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819548 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.819994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.820147 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.820303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.820303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.820595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.820595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821216 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821800 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.821965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.822265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.822429 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.822688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.822848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.822995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.823150 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.823317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.823472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.823625 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.823781 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.823936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824089 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824819 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.824964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.825109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.825281 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.825475 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.825625 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.825770 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.825924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.826105 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.826259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.826415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.826561 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.826707 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.826859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.827392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.827565 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.827727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.827875 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828028 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828495 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828648 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.828940 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.829084 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.829238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.829431 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.829597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.829744 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.829897 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.830106 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.830255 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.830411 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.830566 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.830713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.830858 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831012 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831363 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831518 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.831983 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.832138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.832287 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.832432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.832578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.832843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.833005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.833166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.833314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.833467 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.833632 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.833778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.834033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.834267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.834428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.834582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.834729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.834876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835324 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835479 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.835949 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.836104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.836276 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.836471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.836620 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.836774 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.837002 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.837169 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.837711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.837875 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.837875 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.838188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.838360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.838540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.838690 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.838835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.838980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.839132 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.839287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.839441 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.839595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.839752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.839898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840057 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840204 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840515 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.840968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.841114 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.841259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.841412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.841565 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.841720 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.841888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.842113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.842281 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.842478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.842637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.842797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843070 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.843978 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.844123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.844268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.844422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.844575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.844789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.844947 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.845094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.845438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.845591 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.845738 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.845913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.846659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.846849 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.847009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.847164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.847324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.847892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848062 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848210 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848663 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848817 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.848972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.849119 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.849266 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.849418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.849575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.849734 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.849880 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.850063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.850213 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.850622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.850784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.850784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851508 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.851986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.852138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.852293 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.852293 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.852588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.852733 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.852889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.853054 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.853293 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.853459 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.853614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.853776 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.853952 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.854117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.854271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.854428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.854575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.854727 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.854880 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855039 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855193 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.855961 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.856115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.856272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.856426 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.856571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.856717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.856869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.857030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.857184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.857329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.857483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.858060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.858219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.858391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.858550 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.858704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.858858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859161 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.859908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860518 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860826 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.860986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.861139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.861285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.861437 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.861583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.861739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.861899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.862082 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.862241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.862916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.862916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.863219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.863471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.863623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.863777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.863931 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.864093 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.864250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.864404 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.864549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.864704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.864862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.865905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.866087 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.866242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.866394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.866547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.866702 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.866866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.867013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.867158 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.867303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.867455 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.867611 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.868128 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.868358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.868358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.868649 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.868812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.868969 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.869184 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.869348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.869495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.869641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.869641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.870975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.871130 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.871287 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.871434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.871579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.871734 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.871881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872317 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.872913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.873059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.873224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.873378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.873644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.873807 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.873807 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.874120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.874268 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.874426 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.874581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.874735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.874889 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.875046 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.875193 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.875361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.875507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.875679 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.876378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.876545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.876545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.876839 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.876989 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.877143 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.877297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.877458 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.877612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.877785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.878906 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.879072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.879238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.879399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.879570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.879724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.879876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880027 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880339 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880508 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880836 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.880989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.881277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.881441 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.881604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.881772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.881924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.882208 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.882374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.882542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.882696 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.882867 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.883039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.883200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.883362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.883514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.883682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.883931 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.884100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.884267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.884419 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.884570 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.884723 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.884886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.885038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.885199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.885360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.885520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.885671 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.885832 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886482 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.886955 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887122 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887920 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.887920 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.888311 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.888479 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.888639 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.889108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.889290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.889445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.889605 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.889765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.889917 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.890123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.890287 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.890440 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.890598 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.890750 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.890908 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.891062 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.891223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.891388 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.891539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.891698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.891850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.892977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.893132 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.893283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.893444 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.893624 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.893791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.893987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.894252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.894410 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.894562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.894721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.894873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895034 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895187 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.895995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.896154 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.896316 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.896477 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.896638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.896638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.896946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.897099 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.897259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.897412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.897574 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.897735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.897897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.898130 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.898303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.898536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.898703 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.898880 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.899375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.899538 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.899692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.899843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.900005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.900174 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.900334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.900487 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.900647 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.900800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901007 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901161 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901313 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901474 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901628 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901780 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.901976 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.902150 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.902315 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.902467 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.902630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.902809 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.902969 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.903122 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.903283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.903436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.903589 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.903750 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.903904 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.904063 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.904255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.904531 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.904691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.904854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.905007 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.905168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.905328 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.905481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.905640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.905807 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906526 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906841 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.906994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.907191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.907356 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.907536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.907796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.907796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.908109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.908263 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.908414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.908686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.908935 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.909100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.910204 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.910380 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.910542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.910697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.910864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911331 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911491 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911644 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.911983 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.912144 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.912296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.912447 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.912613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.912766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.912917 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.913076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.913240 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.913392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.913392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.913701 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.913864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.914061 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.914225 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.914377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.914539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.914700 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.914999 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.915159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.915311 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.915483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.915637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.915797 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.915961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.916120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.916282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.916444 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.916597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.916756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.916909 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.917060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.917060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.917436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.917588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.917739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.917908 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.918086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.918256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.918411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.918562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.918806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.918965 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.919117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.919279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.919433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.919584 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.919743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.919933 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.920421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.920584 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.920746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.920907 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.921061 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.921314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.921483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.921635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.921788 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.921994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.922165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.922318 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.922318 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.922635 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.922796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.922969 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.923124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.923275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.923440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.923601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.923761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.924013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.924172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.924453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.924608 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.924771 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.925503 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.925775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.925953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.926126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.926288 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.926440 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.926440 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.926745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.926898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927210 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927373 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.927995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.928146 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.928305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.928625 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.928811 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.929053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.929053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.929348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.929520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.929672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.929835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.930049 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.930224 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.930726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.930881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.931042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.931196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.931355 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.931508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.931668 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.931838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932162 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932313 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.932959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.933111 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.933263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.933424 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.933576 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.933726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.933898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.934080 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.934243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.934396 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.934559 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.934720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.934872 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.935032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.935192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.935353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.935513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.935674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.935948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.936121 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.936281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.936434 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.936593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.936756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.936909 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.937060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.937211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.937361 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.937520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.937686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.937838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.938075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.938232 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.938397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.938560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.938712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.938863 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.939032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.939281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.939448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.939615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.939767 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.939927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.940079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.940242 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.940422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.940980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.941146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.941299 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.941460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.941614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.941766 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.941950 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.942124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.942286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.942441 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.942600 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.942791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.942961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.943114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.943266 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.943429 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.943581 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.943749 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.943902 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944216 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.944994 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.945153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.945153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.945451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.945614 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.945774 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.945968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.946303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.946481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.946651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.946812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.946977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.947129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.947288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.947448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.947611 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.947764 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.947924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.948075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.948241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.948404 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.948572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.948725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.948887 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.949059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.949220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.949564 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.949725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.949886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.950063 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.950228 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.950390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.950553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.951101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.951271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.951425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.951591 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.951751 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.951914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.952068 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.952418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.952586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.952759 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.952914 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.953082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.953243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.953404 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.953563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.953736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.953898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.954089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.954244 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.954395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.954563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.954724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.954886 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955350 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955501 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955827 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.955987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117430) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.956191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.957485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.958740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.960027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.961514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.962692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.963839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.964986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.965732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.966366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.966366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.966366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.966366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.966366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.967760 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.968107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.968448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.968797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.969143 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.969471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.969812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.970183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.970550 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.970876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.971335 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.971571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.972438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.972766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.973083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 05:53:05.973333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 05:53:06.005397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO dbcounter [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Registered counter for database nova_api Jun 21 05:53:06.026152 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_db.sqlalchemy.engines [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.032963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writer thread running {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.036517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO dbcounter [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Registered counter for database nova_api Jun 21 05:53:06.057340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_db.sqlalchemy.engines [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.064192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writer thread running {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.090438 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.context [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e3921fb-c59b-4ca6-b53d-6a0f3973a431(cell1) {{(pid=117430) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 05:53:06.094533 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:53:06.096122 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:53:06.097451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:53:06.099470 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:53:06.101764 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO dbcounter [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Registered counter for database nova_cell0 Jun 21 05:53:06.105824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO dbcounter [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Registered counter for database nova_cell1 Jun 21 05:53:06.115071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_db.sqlalchemy.engines [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.116340 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_db.sqlalchemy.engines [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.121388 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.context [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6e3921fb-c59b-4ca6-b53d-6a0f3973a431(cell1) {{(pid=117431) load_cells /opt/stack/nova/nova/context.py:464}} Jun 21 05:53:06.123170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writer thread running {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.124752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writer thread running {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.125435 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:53:06.127066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:53:06.127866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:53:06.129908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:53:06.131949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO dbcounter [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Registered counter for database nova_cell0 Jun 21 05:53:06.136005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO dbcounter [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Registered counter for database nova_cell1 Jun 21 05:53:06.143917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_db.sqlalchemy.engines [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.145861 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_db.sqlalchemy.engines [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.152861 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writer thread running {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.154171 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writer thread running {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.278866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO dbcounter [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Registered counter for database nova_cell0 Jun 21 05:53:06.286498 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_db.sqlalchemy.engines [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117430) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.291039 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writer thread running {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.303979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO dbcounter [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Registered counter for database nova_cell0 Jun 21 05:53:06.310610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_db.sqlalchemy.engines [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 05:53:06.314951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writer thread running {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 05:53:06.618262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: WARNING keystonemiddleware.auth_token [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:53:06.626242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: WARNING keystonemiddleware.auth_token [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:53:06.634670 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: WARNING keystonemiddleware.auth_token [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:53:06.642983 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: WARNING keystonemiddleware.auth_token [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:53:06.972683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: WARNING keystonemiddleware.auth_token [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:53:06.979008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: WARNING keystonemiddleware.auth_token [None req-bab513c8-0098-4001-8f93-bd4e3e3c731b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:53:06.984558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f838aaa9c0 pid: 117430 (default app) Jun 21 05:53:06.988981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: WARNING keystonemiddleware.auth_token [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 21 05:53:06.995054 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: WARNING keystonemiddleware.auth_token [None req-bda643f4-c064-474c-a7c2-0fa1d7a1789a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 21 05:53:07.000397 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f838aaa9c0 pid: 117431 (default app) Jun 21 05:53:48.643412 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.646333 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.647972 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:48.649364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:50.019234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-84764efc-dac3-421f-b5b8-ba79b7b9db46 tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Action: 'create', calling method: .version_select at 0x7efe5e6e2700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1278736566", "metadata": {"Type": "work"}}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:53:51.614997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-84764efc-dac3-421f-b5b8-ba79b7b9db46 tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.991068 Jun 21 05:53:51.627748 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 1/1] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 21 05:53:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3008 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 05:53:52.085682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2cd6f7d2-481e-41df-8785-e390fca5448f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Calling method '.version_select at 0x7efe5e795280>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:53:52.170377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:52.172747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:52.175318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:52.183159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:53:52.774010 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2cd6f7d2-481e-41df-8785-e390fca5448f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891" status: 200 len: 354 microversion: 2.1 time: 1.143202 Jun 21 05:53:52.774631 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 1/2] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 05:53:51 2022] GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891 => generated 354 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:53:52.788653 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3a92c489-9382-4c5c-bd85-9fb4ccb14acf tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Calling method '.version_select at 0x7efe5e5aa5e0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:53:52.912797 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3a92c489-9382-4c5c-bd85-9fb4ccb14acf tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891" status: 200 len: 354 microversion: 2.1 time: 0.130269 Jun 21 05:53:52.913903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 05:53:52 2022] GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:53:52.930754 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-25cdeec9-a013-4905-b547-34c28856f35e tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Calling method '.version_select at 0x7efe5e5e95e0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:53:53.123431 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-25cdeec9-a013-4905-b547-34c28856f35e tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891" status: 202 len: 0 microversion: 2.1 time: 0.196838 Jun 21 05:53:53.124846 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 05:53:52 2022] DELETE /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:53:53.149045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-90f3608d-f9ff-4a45-b6cc-96da2a68c7b8 tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Calling method '.version_select at 0x7efe5e5aa940>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:53:53.314622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-90f3608d-f9ff-4a45-b6cc-96da2a68c7b8 tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891" status: 200 len: 353 microversion: 2.1 time: 0.182117 Jun 21 05:53:53.315705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 3/5] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 05:53:53 2022] GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:53:54.333637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fc98bfca-2951-4b46-a533-7692f4ef421f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Calling method '.version_select at 0x7efe5e5e9820>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:53:54.434637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-fc98bfca-2951-4b46-a533-7692f4ef421f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] HTTP exception thrown: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fc98bfca-2951-4b46-a533-7692f4ef421f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Request method failure captured: Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891 HTTP/1.1 Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisVzsRDZILJUjZErCom7FHdFoKs6fEz_rFHemQQAMcCSsn7k73zSRBjC_eAQjQzRBUL7VXRNckfYEoPnDmfwhky47lOBfuoh3dCQsfBU5UdlrJEKsgy-qQz05V8EOg2xyl14fFO5d5LCfM_oBYnD1g2342eCP2xq7bY27eEWgxvKmL8U Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 1fa5e44a25e546279833a63424913423 Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesGetTestJSON-589197098 Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:53:54.441284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1fa5e44a25e546279833a63424913423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/1fa5e44a25e546279833a63424913423"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_1fa5e44a25e546279833a63424913423"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/1fa5e44a25e546279833a63424913423"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesGetTestJSON-589197098 Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 1fa5e44a25e546279833a63424913423 Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesGetTestJSON-589197098 Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesGetTestJSON-589197098-project Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: b284d5f52ab54e28ad6558803c09e07f Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesGetTestJSON-589197098-project Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '48826232-3733-4bf2-92f3-4f213e960891'} Jun 21 05:53:54.442972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. (HTTP 404) (Request-ID: req-282f215c-bc20-406d-ba4a-acf847690ddb) Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:53:54.443973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 05:53:54.445323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 05:53:54.446698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. Jun 21 05:53:54.447959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:53:54.459682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fc98bfca-2951-4b46-a533-7692f4ef421f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] Returning 404 to user: Volume 48826232-3733-4bf2-92f3-4f213e960891 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:53:54.460938 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fc98bfca-2951-4b46-a533-7692f4ef421f tempest-VolumesGetTestJSON-589197098 tempest-VolumesGetTestJSON-589197098-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891" status: 404 len: 109 microversion: 2.1 time: 0.134946 Jun 21 05:53:54.464944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 3/6] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 05:53:54 2022] GET /compute/v2.1/os-volumes/48826232-3733-4bf2-92f3-4f213e960891 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:54:04.489320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-977a83b2-6177-4c21-aba5-81fa7991a4d9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'create', calling method: .version_select at 0x7efe5e5aac10>, body: {"keypair": {"name": "tempest-keypair-1774990968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIJND2ZqNG3gcRSRAaO+FdOOkusWiTRA1zAXnWXd7XW84gzZanHhJI+rPJoXRN6vgAnXXfYCXjv7JoSmw6HesXO9Lq52dLyZiQXbof665E4npDRMUz2Hmb99zpXLnpNeg=="}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:04.774567 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-977a83b2-6177-4c21-aba5-81fa7991a4d9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for project d71c895fde074698b9717d2a770ef5bf. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:04.805874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-977a83b2-6177-4c21-aba5-81fa7991a4d9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for user 7e3e3935d57a48f195a568f90ed25a8a and project d71c895fde074698b9717d2a770ef5bf. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:04.968289 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-977a83b2-6177-4c21-aba5-81fa7991a4d9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.828145 Jun 21 05:54:04.971345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 4/7] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Jun 21 05:54:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 832 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 05:54:08.129843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-601323355", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:08.343641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] validate_networks() for [('151c610c-93dc-48d7-b97e-bb2c574c07b6', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:54:08.949806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-539715889", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "networks": [{"uuid": "95d3dade-194b-475d-965d-d590ef17ba90"}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:09.113232 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] validate_networks() for [('95d3dade-194b-475d-965d-d590ef17ba90', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:54:11.868202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:54:11.874444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:54:11.876883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:54:11.879406 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:54:11.882538 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:54:11.966873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:11.967416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:11.968505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:11.981672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:12.146715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:12.183949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for user f2d23615fd6349e1b70fdbad64b89b78 and project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:12.228084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:54:12.242335 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:54:12.557647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f38e5d57-24c0-4c45-bc35-4f5c4f033939 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.700407 Jun 21 05:54:12.566420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 4/8] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:54:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 4710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 05:54:13.323701 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d0352d3f-ebc3-42aa-9e87-950da0c404a9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: .version_select at 0x7efe5dc23160>, body: {"keypair": {"name": "tempest-keypair-1187453177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWOOpZi9skJOfaRRAoiZH0R9ur27M15TEY/fNJ49lbp0AbQLJ8kiCXG9ZJ39yLaDXlE+v42MzC7eV4un/xmD+/5uzQ26wLMoWhKB/ypBDQAdgtj6xZadEgG4bQ8dC0tnQ=="}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:13.413641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:54:13.414804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:54:13.415007 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:54:13.415385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:54:13.415857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:54:13.436226 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-d0352d3f-ebc3-42aa-9e87-950da0c404a9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for project 219135be95384a599a7c8e7df72175c2. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:13.449849 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:13.450705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:13.452062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:13.452812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:13.467369 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-d0352d3f-ebc3-42aa-9e87-950da0c404a9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for user abd380b05ae94a29bdf56c529f1d411e and project 219135be95384a599a7c8e7df72175c2. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:13.635035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d0352d3f-ebc3-42aa-9e87-950da0c404a9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.067207 Jun 21 05:54:13.636624 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 5/9] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:54:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:13.655320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Getting quotas for project 9c9925a32b094db69c8637996e9cafa1. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:13.676379 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Getting quotas for user a6924b4015a7495885d168495a5bfbfc and project 9c9925a32b094db69c8637996e9cafa1. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:13.730734 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:54:13.734109 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:54:13.939331 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6146a01a-ddfc-4167-ab1c-d56b8af29296 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.142900 Jun 21 05:54:13.941299 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 5/10] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:54:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 5153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:54:13.973691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-857eac1c-4500-4498-8a71-4df1b6735476 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:13.976162 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-857eac1c-4500-4498-8a71-4df1b6735476 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:14.263933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ba609497-5812-4089-b4e8-54aea5883d97 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: .version_select at 0x7efe5dc2f790>, body: {"keypair": {"name": "tempest-keypair-1126116869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoG5f3XMFHoLgqwweDI7hxDoUwnGPfAti/H5thEaslLooB4soA2gb9Qq8CNHw+I32CGxGdjX7k6/UbDZ5unaoVTVNAWcsgZuyhDL11aHJRdNYcLdkFDUqYQaRAO+WR7DQ=="}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:14.324368 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-ba609497-5812-4089-b4e8-54aea5883d97 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:14.356010 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-ba609497-5812-4089-b4e8-54aea5883d97 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:14.473898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ba609497-5812-4089-b4e8-54aea5883d97 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.826382 Jun 21 05:54:14.476140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 6/11] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:54:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:14.522163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6dcfb15e-2a91-4ab9-a79c-dfd0ae822bf3 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:14.524218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6dcfb15e-2a91-4ab9-a79c-dfd0ae822bf3 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:14.694562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-857eac1c-4500-4498-8a71-4df1b6735476 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:14.846167 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-857eac1c-4500-4498-8a71-4df1b6735476 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1221 microversion: 2.1 time: 0.902871 Jun 21 05:54:14.852337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:13 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1221 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:14.946446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6dcfb15e-2a91-4ab9-a79c-dfd0ae822bf3 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:14.992420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6dcfb15e-2a91-4ab9-a79c-dfd0ae822bf3 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1214 microversion: 2.1 time: 0.514328 Jun 21 05:54:14.993112 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:14 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1214 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:15.347648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-553712286", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:15.561182 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] validate_networks() for [('151c610c-93dc-48d7-b97e-bb2c574c07b6', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:54:16.011819 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-03022bb5-7105-4360-92da-4ba99c3d99f9 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:16.014903 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-03022bb5-7105-4360-92da-4ba99c3d99f9 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:16.228835 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-03022bb5-7105-4360-92da-4ba99c3d99f9 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:16.264704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-03022bb5-7105-4360-92da-4ba99c3d99f9 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1214 microversion: 2.1 time: 0.241714 Jun 21 05:54:16.264704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 8/14] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:16 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:16.662913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1551070647", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7183839-abdc-439f-b346-d4ec5ebfb8f5"}], "security_groups": [{"name": "tempest-securitygroup--873969557"}], "key_name": "tempest-keypair-1774990968", "user_data": "}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:17.160577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] validate_networks() for [('f7183839-abdc-439f-b346-d4ec5ebfb8f5', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:54:17.334513 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:54:17.336360 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:54:17.337750 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:54:17.338702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:54:17.339646 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:54:17.388276 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:17.390316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:17.398838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:17.399471 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:17.486056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:17.508920 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for user f2d23615fd6349e1b70fdbad64b89b78 and project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:17.546053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:54:17.551946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:54:17.698720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-465691b6-45d5-4f3a-a52c-50ecf67e0037 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.356213 Jun 21 05:54:17.704702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 7/15] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:54:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:54:17.727125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:17.727758 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:17.782044 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:17.785042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:17.791988 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:17.792724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:18.604613 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:54:18.605661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:54:18.606341 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:54:18.606898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:54:18.608215 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:54:18.625121 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:18.625951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:18.627859 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:18.628531 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:18.632490 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:18.662490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for project d71c895fde074698b9717d2a770ef5bf. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:18.672591 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for user 7e3e3935d57a48f195a568f90ed25a8a and project d71c895fde074698b9717d2a770ef5bf. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:18.677707 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-efa31aa8-fa72-412d-ae2b-462710d65023 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1266 microversion: 2.1 time: 0.974474 Jun 21 05:54:18.695245 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:17 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1266 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:18.702250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:18.705466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:54:18.706209 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:18.708705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:54:18.728610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:18.730422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:18.731350 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:18.733181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:18.784586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0b019a19-e8e9-4a4c-a689-162aecb9a8c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.126029 Jun 21 05:54:18.785776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 9/17] 10.222.0.18 () {62 vars in 1187 bytes} [Tue Jun 21 05:54:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 2128 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 21 05:54:18.801980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2ede030b-7535-4484-a8f9-e1dd77c4ca68 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:18.804324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2ede030b-7535-4484-a8f9-e1dd77c4ca68 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:19.090328 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2ede030b-7535-4484-a8f9-e1dd77c4ca68 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:19.106358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2ede030b-7535-4484-a8f9-e1dd77c4ca68 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:19.110615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2ede030b-7535-4484-a8f9-e1dd77c4ca68 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:19.112538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:19.116211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2ede030b-7535-4484-a8f9-e1dd77c4ca68 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1282 microversion: 2.20 time: 0.323745 Jun 21 05:54:19.129308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1f7d8134-ea51-482e-838a-fbf92a1e6b30 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1225 microversion: 2.1 time: 0.437555 Jun 21 05:54:19.129308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 9/18] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:18 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1225 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:19.132710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 10/19] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:18 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1282 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:19.705578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:19.706273 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:19.742465 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:19.742948 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:19.743738 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:19.751294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:19.897725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:19.908933 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f13b2557-6b97-4d51-98d8-531084e524ec tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1272 microversion: 2.1 time: 0.206264 Jun 21 05:54:19.920489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 10/20] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:19 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:20.136593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:20.145273 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:20.145465 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:20.147932 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:20.163192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:20.165093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:20.166463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:20.167791 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:20.168621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:20.169199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:20.170336 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:20.171082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:20.306048 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:20.323464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-614bf007-483f-49e9-bdbe-d74211ffc387 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1225 microversion: 2.1 time: 0.183307 Jun 21 05:54:20.324063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 11/21] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:20 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:20.540314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:20.566111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:20.567814 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:20.569132 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-25f1acc7-c3fb-4045-82f6-e86183a87329 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1286 microversion: 2.20 time: 0.436758 Jun 21 05:54:20.570296 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 11/22] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:20 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1286 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:20.928696 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:20.929307 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:20.935817 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:20.936509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:20.938050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:20.938640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:21.020384 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:21.034415 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-df899845-b0ec-46e8-af5b-4c602aa35e74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1272 microversion: 2.1 time: 0.109364 Jun 21 05:54:21.036178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:20 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:21.350924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:21.351648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-791233217", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d1a065d-e112-4f81-9899-4ee12e5c17d1"}], "security_groups": [{"name": "tempest-securitygroup--2110094209"}], "key_name": "tempest-keypair-1187453177", "user_data": "}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:21.354262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:21.369391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:21.371498 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:21.372358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:21.372757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:21.752844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:21.774016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0c1b8a7f-5273-4c38-bd18-aae486811829 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1217 microversion: 2.1 time: 0.436929 Jun 21 05:54:21.774658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 12/24] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:21 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1217 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:21.788874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:21.789999 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:21.798699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:21.799842 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:21.801614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:21.803949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:22.101000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] validate_networks() for [('0d1a065d-e112-4f81-9899-4ee12e5c17d1', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:54:22.119650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:22.137621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:22.145300 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:22.150002 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a1e83d15-f2d6-4434-9bfc-0d75bade9513 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1278 microversion: 2.20 time: 0.371372 Jun 21 05:54:22.164095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 13/25] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:21 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1278 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:22.175615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:22.176239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:22.190740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:22.191197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:22.191976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:22.192416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:22.461188 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:22.473322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0abe5c03-aa22-4e55-99f8-146f064a15c1 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1272 microversion: 2.1 time: 0.307599 Jun 21 05:54:22.475540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 14/26] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:22 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:22.792654 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:22.793619 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:22.809016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:22.810543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:22.813954 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:22.814887 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:22.997296 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:23.005569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c5a2539c-8858-466e-99cf-9b2e7080b58f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1217 microversion: 2.1 time: 0.218815 Jun 21 05:54:23.006724 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:22 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:23.013203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1880254638", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af2e04db-de33-4272-99f0-75327f84c194"}], "security_groups": [{"name": "tempest-securitygroup--1041302321"}], "key_name": "tempest-keypair-1126116869", "user_data": "}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:23.086946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:54:23.087403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:54:23.087858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:54:23.088330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:54:23.089071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:54:23.109991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:23.111658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:23.115022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:23.128466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:23.196686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for project 219135be95384a599a7c8e7df72175c2. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:23.209219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for user abd380b05ae94a29bdf56c529f1d411e and project 219135be95384a599a7c8e7df72175c2. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:23.247494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:54:23.254468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:54:23.275661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] validate_networks() for [('af2e04db-de33-4272-99f0-75327f84c194', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:54:23.384562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6e215fb8-6c06-4acf-b004-daa0640afbde tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.045215 Jun 21 05:54:23.385869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 13/28] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:54:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 2048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:54:23.399511 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:23.400063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:23.429975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:23.432369 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:23.448822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:23.450926 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:23.791695 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:23.803466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:23.806059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:23.807722 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8b613946-f3dd-4d49-af1b-8c150e4258de tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1278 microversion: 2.20 time: 0.420635 Jun 21 05:54:23.808592 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 14/29] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:23 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1278 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:23.813713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e8decd72-13c0-41a6-9414-596e01dc4625 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:23.814690 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e8decd72-13c0-41a6-9414-596e01dc4625 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:23.975947 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e8decd72-13c0-41a6-9414-596e01dc4625 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:23.986427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e8decd72-13c0-41a6-9414-596e01dc4625 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1237 microversion: 2.1 time: 0.175177 Jun 21 05:54:23.998563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 15/30] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:23 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1237 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:24.013500 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:24.014448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:24.042794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:24.043387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:24.045792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:24.046546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:24.941257 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:24.963175 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-43e6f6ed-121b-4b7e-b117-f78e235d8c99 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.961065 Jun 21 05:54:24.964467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 16/31] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:23 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:24.986868 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:54:24.987365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:54:24.987760 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:54:24.988175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:54:24.989429 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:54:24.991757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:24.999246 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:25.006354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.007112 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.008550 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.009285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.020006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.020461 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.032852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.033446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.098412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:54:25.108177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:54:25.124031 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:54:25.127910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:54:25.237106 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:25.238178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f3a223a8-007f-4e85-94af-163367b38aec tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.230150 Jun 21 05:54:25.238849 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 16/32] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:54:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:54:25.253734 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9068db46-c646-4bac-a9f7-49a461e15bf2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.287914 Jun 21 05:54:25.259444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:25.260598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:25.262211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 17/33] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:24 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:25.266165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:25.291171 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.292500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.293466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.294041 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.312375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:25.313242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:25.364350 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.364888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.366355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.366804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.469387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:25.510807 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:25.515954 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:25.519401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a49472a9-2b69-4909-91d6-28226ed16805 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.271773 Jun 21 05:54:25.521076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 17/34] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:25 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:25.529784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-03ab9b97-9b7b-4f00-8582-b5f4f97aedc8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:25.533358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-03ab9b97-9b7b-4f00-8582-b5f4f97aedc8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:25.565030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:25.605588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a2d46078-9a80-45c5-8334-39042cb8a46e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.314716 Jun 21 05:54:25.614325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 18/35] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:25 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:25.696259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-03ab9b97-9b7b-4f00-8582-b5f4f97aedc8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:25.704361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-03ab9b97-9b7b-4f00-8582-b5f4f97aedc8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1242 microversion: 2.1 time: 0.179870 Jun 21 05:54:25.706604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 18/36] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:25 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1242 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:25.982264 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:25.982954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:25.993665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.995328 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:25.996164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:25.996609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.213071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.226152 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6674174f-2907-496a-8c1d-012997f9b27b tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.248715 Jun 21 05:54:26.226994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:25 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:26.272901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:26.274378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:26.288095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.288927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.289908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.290557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.379372 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.395334 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-abed8f43-67eb-4730-9801-ecb4b0153096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.125699 Jun 21 05:54:26.396560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:26 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:26.543685 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:26.544586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:26.551748 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.552413 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.553453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.554120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.634362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:26.635107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:26.648374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.650045 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.651689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.653534 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.710266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.731501 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.734274 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.742321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f5c2eb5c-555b-4a5c-8257-94145a407c7a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.202379 Jun 21 05:54:26.756664 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:26 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:26.763135 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:26.763595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:26.789134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.792914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.794051 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:26.797501 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:26.829723 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.852253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-41a17e30-1c37-455e-802e-fcff2eddb3df tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.224097 Jun 21 05:54:26.864943 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 20/40] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:26 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:26.925336 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:26.964250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ceb7f01f-a150-45ec-95cc-97fb3d3a40c2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.206565 Jun 21 05:54:26.964841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 21/41] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:26 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:27.246070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:27.246604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:27.253825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.254584 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.260002 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.260718 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.415723 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:27.416627 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:27.431894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.434354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.436590 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.437788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.636039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:27.640717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:27.651655 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b71ffe1f-f89f-4b68-806b-0b50b1045cc3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.242382 Jun 21 05:54:27.652374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 22/42] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:27 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:27.652627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0f696411-77ba-4f86-8f0f-a35a88355d19 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.410873 Jun 21 05:54:27.654830 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 21/43] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:27 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:27.766392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:27.767388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:27.784961 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.786401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.787435 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.788056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.880178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:27.882428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:27.883135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:27.893249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:27.895175 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:27.896583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4de9078c-b8b4-4083-abd3-b07eb5ae25a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.139482 Jun 21 05:54:27.898182 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 23/44] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:27 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:27.913898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.917594 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.917594 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:27.917594 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:27.988013 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:27.989676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:28.000728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:28.002952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:28.005525 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:28.007171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:28.009818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:28.080256 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:28.094074 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3471a752-bb3e-4aa2-a2b7-d636c3bd85f2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.216319 Jun 21 05:54:28.110113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 22/45] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:27 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:28.144878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:28.155277 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1e280fd8-fba2-4009-9214-7814c599fa6f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.171050 Jun 21 05:54:28.156309 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 24/46] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:27 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:28.672918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:28.675034 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:28.676446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:28.677135 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:28.687820 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:28.688274 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:28.690901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:28.692539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:28.693848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:28.695795 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:28.698953 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:28.700040 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:28.775511 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:28.909773 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:28.924861 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-800f7a31-19d3-4490-92e1-f3e13803a122 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.255671 Jun 21 05:54:28.925666 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 23/47] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:28 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:28.950324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:28.955378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:29.020772 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.024981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.027736 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.029560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.241105 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:29.253726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:29.263063 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:29.264569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:29.266284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-88e032c5-aecd-4ad2-ba1c-befe655cab58 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.339401 Jun 21 05:54:29.267119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 24/48] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:28 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:29.267255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d5869d1b-ab09-4889-986d-8c398acfe4bd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.598432 Jun 21 05:54:29.270423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 25/49] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:28 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:29.282018 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:29.282955 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:29.286705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:29.292824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:29.295355 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.297515 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.298467 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.300250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.301462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.304674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.305546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.306015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.420061 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:29.430990 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-52a0be7d-1f6a-4d8e-b4ca-b1cc44e1283c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.162332 Jun 21 05:54:29.434921 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 25/50] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:29 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:29.456806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:29.473010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-25c053ea-d94e-495b-a2b0-50b3c3b8e691 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.200739 Jun 21 05:54:29.483578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 26/51] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:29 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:29.943752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:29.945207 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:29.953107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.954536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:29.958941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:29.960189 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.037705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.046878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e9cfb8ce-0405-430b-a772-6dbbacd8088a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.107308 Jun 21 05:54:30.047469 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 26/52] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:29 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:30.288898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:30.290018 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:30.290952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:30.291563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:30.298876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.299112 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.299540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.299864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.300367 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.300864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.301022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.301451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.404579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.417709 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.419391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.420788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-79b3f352-3750-4e2a-80f2-3b4396fc5c1a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.139511 Jun 21 05:54:30.421587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 27/53] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:30 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:30.452818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:30.453510 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:30.460757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.461568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.462443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.462874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.529410 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.538517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-483c5a95-9d28-4302-a143-200a1b81f9f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.255132 Jun 21 05:54:30.539428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 27/54] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:30 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:30.544315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:30.544867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:30.553052 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.553336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.554182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:30.555050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.558844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:30.563635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3f830f84-b864-4e65-bab9-14f09f59d7ab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.115496 Jun 21 05:54:30.564455 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 28/55] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:30 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:30.581362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:30.639101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:30.647967 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a2104571-7e7e-4e42-ba77-560b3967cdd6 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.107291 Jun 21 05:54:30.648606 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 28/56] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:30 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:31.066533 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:31.067074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:31.073431 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.073874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.074682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.075110 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.155633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.163535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-03429755-ec91-4d4b-a47c-bb1ab7e76a09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.102277 Jun 21 05:54:31.164306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 29/57] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:31 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:31.440101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:31.440807 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:31.447342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.448038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.449023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.449459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.513239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.522788 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.524314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.525450 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b9c2478a-5576-4bac-bd7d-965aa42afdf9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.090147 Jun 21 05:54:31.526117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 29/58] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:31 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:31.556528 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:31.557266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:31.563427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.563874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.564642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.565072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.582352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:31.583059 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:31.589191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.589686 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.590565 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.591067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.679139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.687249 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7f226296-2f90-4eca-b322-f0480236e56b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.108638 Jun 21 05:54:31.688134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 30/59] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:31 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:31.694729 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:31.695628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:31.702092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.703291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.704279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:31.704901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:31.773977 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.782817 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bbe6b21f-232d-4b4a-b62d-eb65e498eee0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.230114 Jun 21 05:54:31.790330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 30/60] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:31 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:31.791531 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:31.802729 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0622ab63-29e4-4098-8677-ab0e27786d70 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.113200 Jun 21 05:54:31.803411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 31/61] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:31 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:32.191573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:32.191573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:32.195248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.195777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.197337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.197712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.288103 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:32.301334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-81ab849d-9c40-4458-b99d-5da7620f01a8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.121071 Jun 21 05:54:32.302873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 31/62] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:32 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:32.545593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:32.546370 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:32.558280 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.560244 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.563835 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.565864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.696913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:32.704868 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:32.706448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:32.716320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:32.718891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:32.721384 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.722171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.726716 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f0e934e3-1d2d-4011-b395-240575d20888 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.183177 Jun 21 05:54:32.727208 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.727888 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 32/63] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:32 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:32.740330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.802968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:32.803243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:32.816568 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.817094 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.819718 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.820474 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.879544 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:32.888044 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b1068c1a-4a18-4543-8d00-e0a3ce912df2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.186933 Jun 21 05:54:32.898968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 32/64] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:32 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:32.905012 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:32.905955 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:32.912595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.912891 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:32.914147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:32.914800 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:33.081897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:33.090880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8f4e68be-55ed-402c-b5fc-df785971e6d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.190163 Jun 21 05:54:33.091632 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:32 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:33.219253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:33.227992 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4a44b00d-2af8-4236-9b4e-4b44deb15a02 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.430196 Jun 21 05:54:33.229622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 33/66] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:32 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:33.318874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:33.319478 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:33.322638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=6 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:33.338581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:33.339027 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:33.339899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:33.340334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:33.426579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:33.436078 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4b9f743c-30fa-4b54-9115-02f1aec21b6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.121191 Jun 21 05:54:33.437086 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 34/67] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:33 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:33.746512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:33.747086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:33.756923 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:33.757491 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:33.758486 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:33.759074 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:33.853379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:33.865281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:33.867470 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:33.869127 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e75a41dc-e61a-4aaa-ab14-f97bddc6d257 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.126908 Jun 21 05:54:33.879124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 34/68] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:33 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:33.907818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:33.908661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:33.924013 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:33.924915 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:33.926295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:33.926969 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.008440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=26 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:34.089454 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.103981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-52876247-92cd-409e-8638-eec483218a5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.200682 Jun 21 05:54:34.113514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 35/69] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:33 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:34.123677 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:34.125061 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:34.131911 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.132678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.133740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.134425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.223945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.237488 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-23adf10f-8546-45d3-a417-cf3aaefaac2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.118720 Jun 21 05:54:34.239441 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 35/70] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:34 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:34.247215 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:34.247758 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:34.268228 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.268760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.269957 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.270484 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.476761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:34.477385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:34.492030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.493091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.494808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.495242 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.627568 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.635842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.643648 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c2c2613b-58c9-43d7-8f7c-d9d24a950b8a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.173945 Jun 21 05:54:34.644388 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 36/71] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:34 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:34.646625 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e662c1f0-0fd8-4345-8023-8c8b896f7110 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.400710 Jun 21 05:54:34.647883 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 36/72] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:34 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:34.889112 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:34.890318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:34.896577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.897119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.897961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:34.898401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:34.962255 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.971209 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.972813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:34.973866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-00d978bb-8cc0-4562-9d0d-89b421036030 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.088945 Jun 21 05:54:34.974734 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 37/73] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:34 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:35.120407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:35.121011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:35.127057 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.127486 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.128236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.129041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.195392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:35.203272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-de3b775a-f940-4ec7-920c-a887206e2570 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.086545 Jun 21 05:54:35.203836 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 37/74] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:35 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:35.255963 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:35.256675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:35.258597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=6 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:35.264245 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.265464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.266233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.266658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.326915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:35.334840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-75bc5369-05dc-4627-9652-55f83392948d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.083016 Jun 21 05:54:35.335401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 38/75] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:35 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:35.662825 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:35.666666 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:35.667276 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:35.668302 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:35.677944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.678432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.679279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.679722 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.683578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.685149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.686165 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:35.687196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:35.706514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=34 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:35.775054 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:35.784958 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a39bf138-ff7b-4388-9364-5b1824b821f4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.127825 Jun 21 05:54:35.785840 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 38/76] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:35 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:35.865352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:35.872779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-70f4fb46-16e3-46fd-9a43-15e49a90a32f tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.212068 Jun 21 05:54:35.873353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 39/77] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:35 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:35.992250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:35.992865 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:35.999280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.000008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.000810 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.001246 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.068268 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:36.076582 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:36.078164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:36.079542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0035a183-50e4-4ad5-9a25-ab6897992f1f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.091206 Jun 21 05:54:36.080062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 39/78] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:35 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:36.221423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:36.222056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:36.228451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.228893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.229653 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.230120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.291569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:36.300086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-706344c1-89fa-4390-9588-abebc0e375ed tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.083455 Jun 21 05:54:36.300663 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 40/79] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:36 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:36.351609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:36.352202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:36.359229 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.359705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.360551 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.360991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.433572 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:36.442631 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8852bb97-c9c7-459f-b1f2-28ea169d4120 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.095179 Jun 21 05:54:36.443297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 40/80] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:36 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:36.802301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:36.802906 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:36.808930 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.809370 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.810154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.810586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.872988 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:36.880932 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a3a8ca26-81e6-4145-9393-000e5f7cff9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.082433 Jun 21 05:54:36.881496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 41/81] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:36 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:36.891792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:36.892327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:36.898512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.898958 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:36.899718 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:36.900154 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.029248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.036702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-00277494-89f6-4151-8cf6-69b548d9d3f6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.149347 Jun 21 05:54:37.037258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 41/82] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:36 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:37.097104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:37.097732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:37.104175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.104621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.105389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.105825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.166561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.175756 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.177259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.178399 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2772a61b-d6f9-4c5a-b2d5-a0225dd19bb3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.085266 Jun 21 05:54:37.178968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 42/83] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:37 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:37.317707 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:37.318379 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:37.324329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.324760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.325500 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.325922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.329800 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:37.389098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.397092 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-08fcacde-9d61-4352-9498-e3294efdef69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1241 microversion: 2.1 time: 0.083215 Jun 21 05:54:37.397653 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 42/84] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:37 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:37.461150 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:37.461678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:37.468397 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.468839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.469586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.470039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.531416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.538953 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b13336fa-00e0-4829-8868-5a2109cb1395 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1246 microversion: 2.1 time: 0.081690 Jun 21 05:54:37.539515 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 43/85] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:37 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:37.898266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:37.898874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:37.904913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.905356 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.906138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:37.906575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:37.967802 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:37.975626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-aab6b254-77a5-45b0-8d18-7fdbfd98f67e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.081195 Jun 21 05:54:37.976132 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 43/86] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:37 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:38.053533 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:38.054610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:38.064747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.065297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.066188 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.066697 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.196021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:38.196624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:38.203048 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.203486 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.204233 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.204652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.210977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:38.219080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-414f7f8c-5265-43ab-a995-4aed8399174d tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.170238 Jun 21 05:54:38.219647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 44/87] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:38 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:38.269366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:38.277436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:38.278954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:38.280138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0a6d03cc-6342-40f5-adaf-f4c217c22aca tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.087982 Jun 21 05:54:38.280687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 44/88] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:38 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:38.414223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:38.414838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:38.420930 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.421374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.422172 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.422607 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.426593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:38.485085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:38.492627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-52ae2033-4cfd-451b-972b-f51e1630812e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1233 microversion: 2.1 time: 0.082251 Jun 21 05:54:38.493203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 45/89] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:38 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1233 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:38.555922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:38.556540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:38.563457 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.563902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.564676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.565102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:38.625897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:38.633211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-91d14e9b-099c-42c3-8029-85101c6d9beb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1238 microversion: 2.1 time: 0.081160 Jun 21 05:54:38.633772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 45/90] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:38 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:38.992587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:38.993188 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:38.999503 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:38.999942 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.000692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.001119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.061557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.069069 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b5a6cb3f-26c2-452e-a963-af99e596e150 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.080316 Jun 21 05:54:39.069636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 46/91] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:38 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:39.236964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:39.237564 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:39.243649 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.244087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.245217 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.245652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.298561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:39.299324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:39.306694 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.307137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.307907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.308339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.382391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.391536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.393038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.394194 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-47af8a7c-0ef9-45b0-815f-3adfd47bc41b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.100205 Jun 21 05:54:39.394765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 47/92] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:39 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:39.404499 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.412514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-69847e7f-fc89-4edb-aa30-dc2c0cab4bc6 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.180255 Jun 21 05:54:39.413087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 46/93] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:39 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:39.510235 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:39.510853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:39.517725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.518211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.518971 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.519437 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.581616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.589203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1104b7e6-ba6f-457a-8fec-ecd92cda7232 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1233 microversion: 2.1 time: 0.083005 Jun 21 05:54:39.589785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 48/94] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:39 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:39.655392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:39.656093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:39.662094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.662559 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.663357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:39.663782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:39.731446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:39.739496 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-704685a6-1b71-4885-8f1b-0d1f933864c8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1238 microversion: 2.1 time: 0.088405 Jun 21 05:54:39.740077 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 47/95] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:39 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:40.086896 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:40.087502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:40.094275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.094727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.095494 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.095927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.165970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.175622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-eb5cd31e-e31b-4936-b51d-9b2b48305fa8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1273 microversion: 2.1 time: 0.093217 Jun 21 05:54:40.176231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 49/96] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:40 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:40.412148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:40.412664 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:40.418786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.419222 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.420014 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.420439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.429037 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:40.429699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:40.435810 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.436775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.437549 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.438006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.487137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.497423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.499960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.501392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5ba76c0e-a896-4255-93e7-f045f6fa9006 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1334 microversion: 2.20 time: 0.093150 Jun 21 05:54:40.502075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 48/97] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:40 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:40.583579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.591197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fc4f11d4-7049-4e31-a9ed-87751e65d912 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.165996 Jun 21 05:54:40.591759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 50/98] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:40 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:40.606153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:40.606756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:40.613320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.613757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.614554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.614977 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.687249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.695122 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-524a02cd-8e3e-4dae-a317-34444b35ea86 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1233 microversion: 2.1 time: 0.092785 Jun 21 05:54:40.695715 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 49/99] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:40 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1233 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:40.756517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:40.757119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:40.763179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.763644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.764394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:40.764821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:40.825220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:40.832803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b63eb51e-7404-4618-9fda-ac5a3f97e38e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1238 microversion: 2.1 time: 0.080132 Jun 21 05:54:40.833381 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 51/100] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:40 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1238 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:41.195910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:41.196940 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:41.207391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.208138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.211579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.212720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.370396 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:41.403058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-76db2a7d-ccae-4ebd-82ab-e1e5ac59784a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1291 microversion: 2.1 time: 0.213565 Jun 21 05:54:41.413385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 50/101] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:41 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1291 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:41.524583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:41.525645 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:41.538186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.538974 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.540330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.541106 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.608868 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:41.609831 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:41.620949 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.624568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.625991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.630181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.681566 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:41.696566 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:41.698683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:41.700453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-24158314-dd0c-4034-b288-0b0cabdf5f9c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1342 microversion: 2.20 time: 0.184049 Jun 21 05:54:41.714910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 52/102] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:41 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1342 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:41.726462 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:41.727812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:41.740492 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.741270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:41.743887 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:41.744819 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.043552 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:42.062828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-efd402ec-91bc-403b-baa6-1a7f30cf4f8a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1289 microversion: 2.1 time: 0.349434 Jun 21 05:54:42.064410 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 53/103] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:41 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1289 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:42.103785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:42.104936 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:42.135002 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:42.135765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.137151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:42.137846 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.477604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:42.506141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-37c103da-b4b6-4b26-8112-7a16339cbe0c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1312 microversion: 2.1 time: 0.438219 Jun 21 05:54:42.509333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 54/104] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:42 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1312 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:42.519991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:42.522749 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:42.539879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:42.540455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.543241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:42.548519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.584605 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:42.638415 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f8c08335-4957-40d1-a875-26f52d2bec8e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 1.029686 Jun 21 05:54:42.643582 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 51/105] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:41 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:42.734742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:42.736093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:42.756476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:42.761454 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.765280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:42.766648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:42.918392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:42.933077 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c06298b7-0bdd-46d8-9138-44380c65200f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1279 microversion: 2.1 time: 0.422032 Jun 21 05:54:42.934181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 55/106] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:42 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1279 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:42.984588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:43.000975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:43.003922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:43.005337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5473969c-f5d4-47c1-8308-5df8aa713c8a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1340 microversion: 2.20 time: 0.282980 Jun 21 05:54:43.007058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 52/107] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:42 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1340 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:43.107111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:43.108978 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:43.118938 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.119610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.120595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.121361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.336212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:43.348665 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a23c3038-ac3f-4341-b303-b41d8d06ce96 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1295 microversion: 2.1 time: 0.245639 Jun 21 05:54:43.350169 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 56/108] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:43 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1295 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:43.537484 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:43.538590 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:43.549493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.550252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.561280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.562616 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.677418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:43.678109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:43.687579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.688030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.690178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:43.693866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.694356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.724634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-39205f5e-4e29-4c49-b389-96b2083b3962 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1300 microversion: 2.1 time: 0.189383 Jun 21 05:54:43.731397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 53/109] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:43 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1300 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:43.955973 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:43.960285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:43.990443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.994774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:43.997518 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:43.999078 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:44.340766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:44.352194 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9c5b3eb0-c854-4ef3-b0b1-0a7bc35cfc74 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.683021 Jun 21 05:54:44.354221 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 57/110] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:43 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:44.364052 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:44.364657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:44.380661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:44.381124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:44.384491 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:44.385178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:44.415351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:44.437602 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-566ad736-ae00-4660-b223-b4f575d5774c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.487056 Jun 21 05:54:44.439144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 54/111] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:43 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:44.459254 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:44.460285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:44.477824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:44.480590 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:44.486761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:44.487553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:44.612706 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:44.625384 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:44.627887 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:44.629726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-72da04e7-9bd9-48e1-b740-d5e52596ddae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.274511 Jun 21 05:54:44.647517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 58/112] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:44 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:44.678197 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:44.688699 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4cf1394e-b6ce-4047-8ae3-dabffe5d730f tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1295 microversion: 2.1 time: 0.246790 Jun 21 05:54:44.689974 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 55/113] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:44 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1295 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:44.748846 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:44.749990 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:44.767843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:44.768714 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:44.769709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:44.770452 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.056213 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:45.083811 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4dea1bc3-ee6e-4c80-9169-0643ae082cdb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1300 microversion: 2.1 time: 0.339326 Jun 21 05:54:45.085478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 59/114] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:44 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1300 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:45.366976 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-f98f0896-7a63-472e-9956-453f97205a96 req-ce6f6d7e-6662-4323-ab9b-433ff97c35c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68510b32-92ff-4e8b-9c40-00a56f652c61", "tag": "e166dd5d-be6c-42ae-ab3a-1615b941b157"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:45.384057 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f98f0896-7a63-472e-9956-453f97205a96 req-ce6f6d7e-6662-4323-ab9b-433ff97c35c1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.384438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:45.385267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:45.386683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f98f0896-7a63-472e-9956-453f97205a96 req-ce6f6d7e-6662-4323-ab9b-433ff97c35c1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.395539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.396072 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.397007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.398019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.429543 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-f98f0896-7a63-472e-9956-453f97205a96 req-ce6f6d7e-6662-4323-ab9b-433ff97c35c1 service nova] Creating event network-changed:e166dd5d-be6c-42ae-ab3a-1615b941b157 for instance 68510b32-92ff-4e8b-9c40-00a56f652c61 on hv-cinder-84690 Jun 21 05:54:45.431725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f98f0896-7a63-472e-9956-453f97205a96 req-ce6f6d7e-6662-4323-ab9b-433ff97c35c1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117430) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 05:54:45.433220 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.434478 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.435691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.437092 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.452974 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.compute.rpcapi [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 05:54:45.454806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] Releasing lock "compute-rpcapi-router" {{(pid=117430) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 05:54:45.503557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-850c1c19-f525-4621-aec3-77ac2ce91288 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.267978 Jun 21 05:54:45.505580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 56/115] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:45.523700 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:45.527059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:45.543579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.544455 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.546662 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.548265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.572142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:45.584126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9c673186-40ba-4ce8-9713-e17969d7f5dd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.206311 Jun 21 05:54:45.585391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 60/116] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:45 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:45.654561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:45.656337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:45.664362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.664897 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.665884 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.666597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:45.963704 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:45.977511 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7655f77a-2bea-4a3e-8adf-d6228e065ae4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.468870 Jun 21 05:54:45.979408 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 57/117] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:45 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:45.988293 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:45.989350 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:45.998762 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:45.999886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:46.001043 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:46.001753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:46.249577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:46.256506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:46.265452 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:46.267803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:46.269352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2d8ab294-ca11-412e-90ea-b66031cdcc9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.619799 Jun 21 05:54:46.281390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 61/118] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:45 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:46.286928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:46.291610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:46.299024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:46.309710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7edca4d6-2ed3-4f63-9eda-51b550d303e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1295 microversion: 2.1 time: 0.327148 Jun 21 05:54:46.310543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:46.310663 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 58/119] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:45 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1295 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:46.311603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:46.312391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:46.312824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:46.446544 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:46.465291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f59bcdde-cd19-4a5e-b38c-ecc21f190986 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1300 microversion: 2.1 time: 0.182032 Jun 21 05:54:46.466434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 62/120] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:46 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1300 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:46.603647 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:46.604377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:46.616263 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:46.624470 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:46.630250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:46.630908 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:46.644019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:46.996228 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:46.997563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:47.009025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.009472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:47.010305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.010734 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:47.163116 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:47.182914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-175d957a-dce0-48e6-b923-1bf023ecdf35 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.584114 Jun 21 05:54:47.183945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 59/121] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:46 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:47.295111 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:47.296396 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:47.313053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.313709 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:47.320148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.320805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:47.797493 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:47.809442 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d0ffc244-f56f-47f9-9d5b-50ef39db8e76 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.817148 Jun 21 05:54:47.811992 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 63/122] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:46 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:47.829317 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:47.833585 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:47.852942 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.853695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:47.854783 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.858084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:47.934128 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:47.945013 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:47.955938 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:47.957350 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-13f80aa1-0089-4b0a-ad54-f4ba61fe14bb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.668798 Jun 21 05:54:47.958097 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 60/123] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:47 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:47.973219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:47.985460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:47.996483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:47.999742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.000745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.002678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.098185 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:48.119522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0100c465-2880-4060-b32e-48baffd53698 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1295 microversion: 2.1 time: 0.303682 Jun 21 05:54:48.120822 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 64/124] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:47 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1295 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:48.127481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-6c74fdd0-9c7f-451f-8141-39fbfda235c8 req-8f6b1098-5248-44fa-b118-6ea707e93879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be655d46-baab-49d2-842e-55873b5e4e91", "tag": "3b55b939-e669-4c15-98a5-c5175355b381"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:48.150539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6c74fdd0-9c7f-451f-8141-39fbfda235c8 req-8f6b1098-5248-44fa-b118-6ea707e93879 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.151693 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6c74fdd0-9c7f-451f-8141-39fbfda235c8 req-8f6b1098-5248-44fa-b118-6ea707e93879 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.182918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-6c74fdd0-9c7f-451f-8141-39fbfda235c8 req-8f6b1098-5248-44fa-b118-6ea707e93879 service nova] Creating event network-changed:3b55b939-e669-4c15-98a5-c5175355b381 for instance be655d46-baab-49d2-842e-55873b5e4e91 on hv-cinder-84690 Jun 21 05:54:48.183877 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6c74fdd0-9c7f-451f-8141-39fbfda235c8 req-8f6b1098-5248-44fa-b118-6ea707e93879 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 21 05:54:48.185332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.187008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.188009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.188503 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.201548 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.compute.rpcapi [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 21 05:54:48.202808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 21 05:54:48.223176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f9ffd78c-2356-436a-959e-26042d2856f5 None None] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100606 Jun 21 05:54:48.224934 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 65/125] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:48.233901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:48.233901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:48.242027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:48.251470 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.252808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.255139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.256824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.486851 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:48.507016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ac1073b1-b5bb-4a2b-ab31-a618ab89bd0e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.537117 Jun 21 05:54:48.518353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 61/126] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:47 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:48.833068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:48.833999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:48.851922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.852573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:48.853573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:48.859625 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.013054 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:49.028285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ffda73f2-e2b7-4b6e-9cb0-33b96b242928 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.801631 Jun 21 05:54:49.029050 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 66/127] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:48 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:49.039202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:49.039803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:49.049196 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.049842 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.050873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.051532 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.341430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:49.357154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:49.359391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2a28cf7f-8c68-494e-a891-b28578baca21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.530725 Jun 21 05:54:49.360261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 62/128] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:48 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:49.421449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:49.434015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:49.438179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f5864159-38ab-4ef7-8e1b-bbc894e7502f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.402318 Jun 21 05:54:49.439377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 67/129] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:49 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:49.461851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:49.462805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:49.476734 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.477390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.478647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.479285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.489126 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-b0d43679-a59c-4b62-b33a-39add14a8f4d req-7affda46-33fd-4d0a-badf-9343b20de6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:49.506162 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-b0d43679-a59c-4b62-b33a-39add14a8f4d req-7affda46-33fd-4d0a-badf-9343b20de6f7 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.509626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-b0d43679-a59c-4b62-b33a-39add14a8f4d req-7affda46-33fd-4d0a-badf-9343b20de6f7 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.539941 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-b0d43679-a59c-4b62-b33a-39add14a8f4d req-7affda46-33fd-4d0a-badf-9343b20de6f7 service nova] Creating event network-changed:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:54:49.562487 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-b0d43679-a59c-4b62-b33a-39add14a8f4d req-7affda46-33fd-4d0a-badf-9343b20de6f7 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201172 Jun 21 05:54:49.565214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 63/130] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:49.592823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:49.594882 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:49.611578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.613440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:49.614539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:49.617069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.092119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.117371 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-34432f82-de93-488d-90c9-f2f7b1584f02 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.674938 Jun 21 05:54:50.122138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 68/131] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:49 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:50.132168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:50.133167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:50.142422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.143093 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.144157 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.144809 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.190765 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.215083 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-95d73213-e949-4844-abff-756a60c7c13f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.645097 Jun 21 05:54:50.215682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 64/132] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:49 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:50.271920 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-5ac5e54a-b5b0-47b2-bf5d-46cd0999536c req-a7e1d0f7-d862-45cb-9a54-9c5bb8ebbfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aa48120-9328-4812-bcaa-9f731723b815", "tag": "9e97f399-c2e0-4a28-b1f4-99873b2113ef"}, {"name": "network-changed", "server_uuid": "598a1303-6c97-4b4d-832a-81f96b131503", "tag": "6a306a06-4c23-4c15-b5bb-522ebc76e824"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:50.289517 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-5ac5e54a-b5b0-47b2-bf5d-46cd0999536c req-a7e1d0f7-d862-45cb-9a54-9c5bb8ebbfd5 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.290427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-5ac5e54a-b5b0-47b2-bf5d-46cd0999536c req-a7e1d0f7-d862-45cb-9a54-9c5bb8ebbfd5 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.311532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-5ac5e54a-b5b0-47b2-bf5d-46cd0999536c req-a7e1d0f7-d862-45cb-9a54-9c5bb8ebbfd5 service nova] Creating event network-changed:9e97f399-c2e0-4a28-b1f4-99873b2113ef for instance 4aa48120-9328-4812-bcaa-9f731723b815 on hv-cinder-84690 Jun 21 05:54:50.312524 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-5ac5e54a-b5b0-47b2-bf5d-46cd0999536c req-a7e1d0f7-d862-45cb-9a54-9c5bb8ebbfd5 service nova] Creating event network-changed:6a306a06-4c23-4c15-b5bb-522ebc76e824 for instance 598a1303-6c97-4b4d-832a-81f96b131503 on hv-cinder-84690 Jun 21 05:54:50.322711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-5ac5e54a-b5b0-47b2-bf5d-46cd0999536c req-a7e1d0f7-d862-45cb-9a54-9c5bb8ebbfd5 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059331 Jun 21 05:54:50.323993 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 65/133] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:50.376724 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.385502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:50.387873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:50.394664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7c1d66ef-86d7-4e66-b4ab-852af0a041dc tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.268791 Jun 21 05:54:50.396593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 69/134] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:50 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:50.397541 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.398366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.399453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.400171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.475419 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:50.477024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:50.502399 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.503551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.505203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:50.506600 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:50.746480 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.765534 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-31b6d36f-ad26-4680-a4c1-7319f43a6347 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.385279 Jun 21 05:54:50.766643 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 66/135] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:50 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:50.789148 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.801100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.802869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:50.804156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-95639319-8c45-4a63-8024-8511b55580a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.337744 Jun 21 05:54:50.806498 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 70/136] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:50 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:51.136808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:51.137959 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:51.146765 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.147821 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.149699 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.151248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.251340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:51.260065 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:51.282268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.283401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.284588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.285102 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.406089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:51.418134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1b736b06-76d3-4152-8986-ee7f3284f50d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.284431 Jun 21 05:54:51.418786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 67/137] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:51 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:51.427126 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:51.428022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:51.438691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.439630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.441672 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.442564 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.612902 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:51.632314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3afbfd6a-7185-452a-9ec1-8004a37c740f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.398504 Jun 21 05:54:51.634048 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 71/138] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:51 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:51.738935 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:51.751550 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e25bce6e-678b-4a4c-b6a6-560b51ab94c8 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.330749 Jun 21 05:54:51.752502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 68/139] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:51 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:51.785641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:51.786570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:51.814250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.814926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.816113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.817408 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.826836 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:51.827967 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:51.840724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.841539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:51.843950 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:51.847249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:52.525964 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:52.536186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2a3dbf30-7840-4b77-9106-653999851a97 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.755289 Jun 21 05:54:52.540556 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 72/140] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:51 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:52.554145 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:52.555258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:52.569076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:52.571555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:52.574799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:52.575423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:52.712387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:52.743766 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:52.752858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:52.760819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d7f32d1b-aaa4-43d7-a533-6d9135138866 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.933782 Jun 21 05:54:52.761690 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 69/141] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:51 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:52.853629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:52.855018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:52.884284 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:52.887784 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:52.888882 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:52.889542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.088685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:53.105673 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-00f366dc-415e-4f1c-a1a9-259231e13312 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.558201 Jun 21 05:54:53.108872 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 73/142] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:52 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:53.118835 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:53.124801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:53.147333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.147848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.148926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.149455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.236667 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:53.251946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2f2c2411-ff87-4233-a232-5f074f052de3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.458535 Jun 21 05:54:53.270228 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 70/143] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:52 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:53.309812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-cb921f06-4a99-451b-8ade-305f44b229cc req-a5a0f95a-878b-4a24-b392-79b14b3ef18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a038cbd5-199a-4273-8ded-1fd9a3528a0e", "tag": "34000dbd-bc1c-43fa-96d9-b96ba4703a5f"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:53.339514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-cb921f06-4a99-451b-8ade-305f44b229cc req-a5a0f95a-878b-4a24-b392-79b14b3ef18d service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.340089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-cb921f06-4a99-451b-8ade-305f44b229cc req-a5a0f95a-878b-4a24-b392-79b14b3ef18d service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.355537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-cb921f06-4a99-451b-8ade-305f44b229cc req-a5a0f95a-878b-4a24-b392-79b14b3ef18d service nova] Creating event network-changed:34000dbd-bc1c-43fa-96d9-b96ba4703a5f for instance a038cbd5-199a-4273-8ded-1fd9a3528a0e on hv-cinder-84690 Jun 21 05:54:53.361382 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-cb921f06-4a99-451b-8ade-305f44b229cc req-a5a0f95a-878b-4a24-b392-79b14b3ef18d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089573 Jun 21 05:54:53.362349 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 71/144] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:53.447364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:53.467994 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0a6642ca-47bc-4f99-9a90-57cf3e9ff603 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.356875 Jun 21 05:54:53.468945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 74/145] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:53 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:53.571582 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:53.574198 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:53.600574 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.601508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.605314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.606213 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.798505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:53.800915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:53.825051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.828695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.832481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:53.836492 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:53.999605 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:54.035240 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c4f8694d-d00c-46cc-a6a5-2ea7600856b5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.475403 Jun 21 05:54:54.036682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 72/146] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:53 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:54.126510 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:54.127179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:54.139532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:54.144995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:54.146084 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:54.146705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:54.615962 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:54.632403 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:54.637157 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:54.641642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a40d2499-a76a-4d9a-8cdf-4487e0f2746d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.850464 Jun 21 05:54:54.642477 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:54.644551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 75/147] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:53 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:54.658883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:54.659520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:54.664695 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c72edc6f-35a2-43fd-96ca-523b527f5508 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.545122 Jun 21 05:54:54.665856 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 73/148] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:54 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:54.672833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:54.673839 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:54.674417 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:54.674878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:54.677831 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:54.679168 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:54.683908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:54.689870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:54.690826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:54.691996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:54.692725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.264715 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:55.274203 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9a80ad25-612d-43a5-9b91-05e87170df9c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.606260 Jun 21 05:54:55.274922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 74/149] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:54 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:55.280989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:55.281698 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:55.297521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:55.298698 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.299580 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:55.300143 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:55.300143 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.313733 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-35eb8b3e-491c-43d5-aea0-a5bd27e8ca64 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.665962 Jun 21 05:54:55.314466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 76/150] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:54 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:55.444159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:55.449377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:55.461783 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5b03ef4a-ae70-4d52-8cdd-97c57cfe92e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.185079 Jun 21 05:54:55.462430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 75/151] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:55 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:55.664147 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:55.664768 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:55.671709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:55.672163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.673320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:55.673916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.683484 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:55.684080 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:55.697103 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:55.698127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.699081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:55.700832 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:55.982131 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:55.993418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:55.999007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:56.000888 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:56.002236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-87dd9ebb-4add-4295-b816-f13bd9992048 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.322486 Jun 21 05:54:56.003006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0aaf3a2e-76fb-4038-ab44-5c689feba624 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.343385 Jun 21 05:54:56.012403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 76/152] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:55 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:56.015446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 77/153] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:55 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:56.302612 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:56.303315 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:56.310062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:56.311159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:56.312006 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:56.312820 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:56.333173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:56.335115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:56.340044 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:56.340499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:56.346238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:56.346965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:56.618535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:56.622302 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:56.633726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f3ebee48-d48e-4234-898c-a8fb8c75aa54 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.337480 Jun 21 05:54:56.645139 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 77/154] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:56 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:56.649913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:56.650831 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:56.660549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:56.661392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:56.662554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:56.666230 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:56.675583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:56.684474 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:56.706096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9d467def-fc9b-48b1-b539-52d5568710b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.374206 Jun 21 05:54:56.706803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 78/155] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:56 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:56.967891 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:56.980886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ccf16742-85fc-4690-baa9-0bde2101d10f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.342962 Jun 21 05:54:56.981466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 78/156] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:56 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:57.019837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:57.020375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:57.027449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.028186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.030986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.031758 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.055095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-e673b457-5ea2-466b-8369-2a50e9bc06c5 req-abd2a60e-01db-4484-8287-15806b38183b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be655d46-baab-49d2-842e-55873b5e4e91", "name": "network-vif-plugged", "status": "completed", "tag": "3b55b939-e669-4c15-98a5-c5175355b381"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:57.069589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-e673b457-5ea2-466b-8369-2a50e9bc06c5 req-abd2a60e-01db-4484-8287-15806b38183b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.070481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-e673b457-5ea2-466b-8369-2a50e9bc06c5 req-abd2a60e-01db-4484-8287-15806b38183b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.114281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-e673b457-5ea2-466b-8369-2a50e9bc06c5 req-abd2a60e-01db-4484-8287-15806b38183b service nova] Creating event network-vif-plugged:3b55b939-e669-4c15-98a5-c5175355b381 for instance be655d46-baab-49d2-842e-55873b5e4e91 on hv-cinder-84690 Jun 21 05:54:57.136335 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-e673b457-5ea2-466b-8369-2a50e9bc06c5 req-abd2a60e-01db-4484-8287-15806b38183b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182434 Jun 21 05:54:57.139219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 79/157] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:57.151729 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:57.155856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:57.169407 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.170217 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.171205 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.171986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.249282 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:57.260623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-04beb539-8b26-4aec-9e9a-c1394adffdf9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.244704 Jun 21 05:54:57.264348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 79/158] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:57 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:57.433066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:57.448933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:57.452123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:57.453589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-90b25980-4117-4161-96b4-e4cdfcd5fe46 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.308226 Jun 21 05:54:57.465197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 80/159] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:57 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:54:57.656711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:57.658696 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:57.672037 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.674472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.676322 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.677112 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.728937 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:57.733436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:57.752491 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.753104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:57.754178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:57.755135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.023870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.036997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-56982551-22d9-4f91-a8f4-05ec2bfff62e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.387735 Jun 21 05:54:58.037961 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 80/160] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:57 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:58.047794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:58.049147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:58.058004 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:58.058912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.061019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:58.061984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.093910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.121676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0c13cebb-27a7-415c-a0af-81c872dc385b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.400218 Jun 21 05:54:58.130126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 81/161] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:57 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:58.285854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:58.286641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:58.294156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:54:58.300771 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:58.302792 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.306604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:58.307910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.373699 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.384030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c535855e-db8f-443a-bdec-b1c75aaf5992 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.341848 Jun 21 05:54:58.384634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 81/162] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:58 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:58.471444 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:58.472072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:58.478615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:58.479060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.479824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:58.480251 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:58.742869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.753555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c8c41091-d106-49d6-baea-1575fd6a1cab tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.471856 Jun 21 05:54:58.757659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 82/163] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:58 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:54:58.776709 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.792694 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.796087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:58.797467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1816a168-d6c6-44fc-b054-a652019f22fb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.329818 Jun 21 05:54:58.798827 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 82/164] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:58 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:54:59.055448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:59.056117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:59.063648 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.064098 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.064854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.065333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.146328 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:59.147125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:59.153736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.154254 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.155024 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.155463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.284365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:59.302049 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-02462e28-3e10-4e75-a9de-115cc8e4c517 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.247239 Jun 21 05:54:59.304005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 83/165] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:59 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:59.330851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-f2864634-6199-4fbc-bf67-3feaea79064c req-33ab23c2-a764-412a-bf38-02d9968a67e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68510b32-92ff-4e8b-9c40-00a56f652c61", "name": "network-vif-plugged", "status": "completed", "tag": "e166dd5d-be6c-42ae-ab3a-1615b941b157"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:54:59.352098 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-f2864634-6199-4fbc-bf67-3feaea79064c req-33ab23c2-a764-412a-bf38-02d9968a67e1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.359533 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-f2864634-6199-4fbc-bf67-3feaea79064c req-33ab23c2-a764-412a-bf38-02d9968a67e1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.397252 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-f2864634-6199-4fbc-bf67-3feaea79064c req-33ab23c2-a764-412a-bf38-02d9968a67e1 service nova] Creating event network-vif-plugged:e166dd5d-be6c-42ae-ab3a-1615b941b157 for instance 68510b32-92ff-4e8b-9c40-00a56f652c61 on hv-cinder-84690 Jun 21 05:54:59.416083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-f2864634-6199-4fbc-bf67-3feaea79064c req-33ab23c2-a764-412a-bf38-02d9968a67e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096962 Jun 21 05:54:59.420965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 84/166] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:54:59.428238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:59.432028 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:59.443096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:59.455162 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-83e4893a-ada3-48dc-8bf7-11a28fb1620d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.312274 Jun 21 05:54:59.462849 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 83/167] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:59 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:54:59.474651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.476918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.478664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.480425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.775576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:54:59.776193 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:54:59.785490 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.786256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.786838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:54:59.787277 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:54:59.962528 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:54:59.977349 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fe73f8aa-06e7-404c-9441-1e6d8a36be6f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.553563 Jun 21 05:54:59.977980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 85/168] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:59 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:00.008917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:00.009560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:00.031439 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:00.032719 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:00.033520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:00.033976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:00.185747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:00.208999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c3db153a-6757-451b-8cae-5b04b97c9347 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.436903 Jun 21 05:55:00.209512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 84/169] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:54:59 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:00.322158 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:00.323019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:00.330374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:00.331162 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:00.331763 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:00.332154 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:00.424293 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:00.440803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:00.446508 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:00.448746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8de6aae4-37e3-4c32-a875-73c7b1b809d5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.468483 Jun 21 05:55:00.453065 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 86/170] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:54:59 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:55:00.488797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:00.490080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:00.498661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:00.499350 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:00.500624 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:00.501317 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:00.549358 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:00.567402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7308dab1-e489-4066-bc05-01354dcd31a0 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.248565 Jun 21 05:55:00.567534 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 85/171] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:00 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:00.678434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:00.690284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d7dc6f7e-4d77-41b8-8f17-338acc370fc9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.213932 Jun 21 05:55:00.691238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 87/172] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:00 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:00.995388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:00.996731 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:01.004021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.004704 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.005621 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.006357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.216056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:01.226661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-36ea2728-c991-4f02-9809-f69ec46359b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.235935 Jun 21 05:55:01.227183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:01.227872 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:01.228424 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 86/173] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:00 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:01.241699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.242281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.244581 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.246488 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.434552 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:01.443855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-82f4062f-ac00-40a4-acee-c1113bb6d455 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.221514 Jun 21 05:55:01.444833 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 88/174] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:01 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:01.471635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:01.472471 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:01.479777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.480468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.481450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.482657 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.487692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-0c2f5b16-521c-4d61-b0c3-f454867ac173 req-8e76a712-78f7-455b-b04e-0cdf8d10e235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038cbd5-199a-4273-8ded-1fd9a3528a0e", "name": "network-vif-plugged", "status": "completed", "tag": "34000dbd-bc1c-43fa-96d9-b96ba4703a5f"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:01.512306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-0c2f5b16-521c-4d61-b0c3-f454867ac173 req-8e76a712-78f7-455b-b04e-0cdf8d10e235 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.514898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-0c2f5b16-521c-4d61-b0c3-f454867ac173 req-8e76a712-78f7-455b-b04e-0cdf8d10e235 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.534098 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-0c2f5b16-521c-4d61-b0c3-f454867ac173 req-8e76a712-78f7-455b-b04e-0cdf8d10e235 service nova] Creating event network-vif-plugged:34000dbd-bc1c-43fa-96d9-b96ba4703a5f for instance a038cbd5-199a-4273-8ded-1fd9a3528a0e on hv-cinder-84690 Jun 21 05:55:01.541564 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-0c2f5b16-521c-4d61-b0c3-f454867ac173 req-8e76a712-78f7-455b-b04e-0cdf8d10e235 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059496 Jun 21 05:55:01.543667 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 89/175] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:55:01.601464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:01.603007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:01.634601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.636363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.639606 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.641144 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.677895 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:01.687318 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:01.689248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:01.690506 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6d1d7e8d-635a-4910-a467-1187073f1d87 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.222763 Jun 21 05:55:01.691067 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 87/176] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:01 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:55:01.709450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:01.710137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:01.728069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.728692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.730710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:01.735929 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:01.994084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.006473 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ae37d936-75a1-4fe7-8b2b-13215c1d0b18 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1314 microversion: 2.1 time: 0.413204 Jun 21 05:55:02.006924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 90/177] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:01 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:02.021224 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.032839 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-39f47f13-543d-4f6b-823d-7879439306e5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.327847 Jun 21 05:55:02.033954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 88/178] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:01 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:02.244978 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:02.246235 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:02.262474 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:02.262935 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:02.263782 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:02.264215 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:02.460984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:02.461870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:02.479032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:02.482727 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:02.484739 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:02.486164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:02.537188 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.545261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f90790ab-25c8-47ec-8aee-3dc140e64f66 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.303530 Jun 21 05:55:02.547603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 91/179] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:02 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:02.711386 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:02.712378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:02.721206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:02.722670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.723185 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:02.724337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:02.724746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:02.736067 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-85a34768-9409-4486-9cf8-7e7ffdb6de08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.280188 Jun 21 05:55:02.737042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 89/180] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:02 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:02.927284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.938237 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.939759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:02.940878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-48a97955-ec2c-46a1-9193-b79466b6db8d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.235697 Jun 21 05:55:02.953901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 92/181] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:02 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:55:03.024436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:03.025136 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:03.032501 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.032947 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.033713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.034177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.050507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:03.051214 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:03.062779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.065833 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.067199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.067711 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.334334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:03.343340 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-648fefc3-6dbd-448f-b999-87536adc5c24 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1501 microversion: 2.1 time: 0.323119 Jun 21 05:55:03.344231 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 90/182] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:03 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:03.398226 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:03.410820 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a5c31256-3f2c-4201-80fc-0e5c46eea5af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.364505 Jun 21 05:55:03.411415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 93/183] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:03 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:03.558554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-a88774e1-fd51-4921-936f-a84f454fadac req-afe2ffc5-277a-4d22-ab1b-5f1d9953a811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598a1303-6c97-4b4d-832a-81f96b131503", "name": "network-vif-plugged", "status": "completed", "tag": "6a306a06-4c23-4c15-b5bb-522ebc76e824"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:03.565010 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:03.565765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:03.576306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.577109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.578176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.578641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-a88774e1-fd51-4921-936f-a84f454fadac req-afe2ffc5-277a-4d22-ab1b-5f1d9953a811 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.579082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-a88774e1-fd51-4921-936f-a84f454fadac req-afe2ffc5-277a-4d22-ab1b-5f1d9953a811 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.579309 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.602017 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-a88774e1-fd51-4921-936f-a84f454fadac req-afe2ffc5-277a-4d22-ab1b-5f1d9953a811 service nova] Creating event network-vif-plugged:6a306a06-4c23-4c15-b5bb-522ebc76e824 for instance 598a1303-6c97-4b4d-832a-81f96b131503 on hv-cinder-84690 Jun 21 05:55:03.607777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-a88774e1-fd51-4921-936f-a84f454fadac req-afe2ffc5-277a-4d22-ab1b-5f1d9953a811 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053037 Jun 21 05:55:03.608383 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 91/184] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:03.762162 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:03.762986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:03.784835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.786212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.787813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.788490 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.874611 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:03.899365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d9239283-0789-4909-bd41-aa50167d6448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.337292 Jun 21 05:55:03.910137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 94/185] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:03 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:03.961265 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:03.961523 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:03.970896 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.976883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:03.980372 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:03.980961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:04.246330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:04.271738 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-01fcdcd8-5068-4eda-926f-33dbc556ea21 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1363 microversion: 2.1 time: 0.516673 Jun 21 05:55:04.283643 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 92/186] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:03 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1363 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:04.384133 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:04.394887 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:04.396866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:04.399020 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-48195601-941d-42d2-ae1a-14936f3f0319 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.442063 Jun 21 05:55:04.400914 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 95/187] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:03 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:55:04.428900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:04.429882 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:04.437974 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:04.438637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:04.439601 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:04.440322 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:04.694792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:04.701906 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-facbd751-237e-4176-ba8d-b222f9444e76 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1368 microversion: 2.1 time: 0.277717 Jun 21 05:55:04.702521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 93/188] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:04 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:04.917235 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:04.918037 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:04.925100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:04.925546 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:04.926523 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:04.926959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.070991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:05.080527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4db0fd6d-8855-4e44-af03-17a8e79de271 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.167224 Jun 21 05:55:05.081570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 96/189] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:04 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:05.290134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:05.290747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:05.299716 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:05.300173 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.300950 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:05.301383 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.420337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:05.420949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:05.436304 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:05.436795 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.438097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:05.438717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.474981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:05.563219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:05.582866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-34b4e5ff-4024-47bd-938c-d53b4b666f87 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1549 microversion: 2.1 time: 0.295707 Jun 21 05:55:05.602128 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 94/190] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:05 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1549 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:05.608645 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1694495169", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "networks": [{"uuid": "384d9f09-0db5-4d95-aab9-02eb51e6286a"}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:05.690799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] validate_networks() for [('384d9f09-0db5-4d95-aab9-02eb51e6286a', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:55:05.708778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:05.727609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:05.729573 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:05.731007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c3d35c85-ba42-4178-bf79-be018d9bfe2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.316431 Jun 21 05:55:05.732708 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 97/191] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:05 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:55:05.744636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:05.745487 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:05.756972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:05.757806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.758968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:05.759696 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:05.977330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a1320401-0257-4a08-aea6-a9bd72ace469 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.243334 Jun 21 05:55:05.978019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 98/192] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:55:05 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:05.996998 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-ecdb58d8-5244-4179-8ef8-44a0109a9178 req-75cd6f94-e155-4105-af6e-b093536f1e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa48120-9328-4812-bcaa-9f731723b815", "name": "network-vif-plugged", "status": "completed", "tag": "9e97f399-c2e0-4a28-b1f4-99873b2113ef"}, {"server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "name": "network-vif-plugged", "status": "completed", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:06.017440 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ecdb58d8-5244-4179-8ef8-44a0109a9178 req-75cd6f94-e155-4105-af6e-b093536f1e74 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.018200 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ecdb58d8-5244-4179-8ef8-44a0109a9178 req-75cd6f94-e155-4105-af6e-b093536f1e74 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.048625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-ecdb58d8-5244-4179-8ef8-44a0109a9178 req-75cd6f94-e155-4105-af6e-b093536f1e74 service nova] Creating event network-vif-plugged:9e97f399-c2e0-4a28-b1f4-99873b2113ef for instance 4aa48120-9328-4812-bcaa-9f731723b815 on hv-cinder-84690 Jun 21 05:55:06.049303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-ecdb58d8-5244-4179-8ef8-44a0109a9178 req-75cd6f94-e155-4105-af6e-b093536f1e74 service nova] Creating event network-vif-plugged:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:55:06.057105 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-ecdb58d8-5244-4179-8ef8-44a0109a9178 req-75cd6f94-e155-4105-af6e-b093536f1e74 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077566 Jun 21 05:55:06.058325 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 99/193] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:06.064609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfe9960b-8740-4b02-b155-1253676e44f7"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:06.066431 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:06.073156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.073739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.074646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.075352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.280541 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:55:06.280859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:55:06.281329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:55:06.282011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:55:06.282423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:55:06.294218 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.295924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.297118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.297720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.307823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:06.321046 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Getting quotas for project cbeaefc57cd14db6ba982fc059b70b70. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:55:06.326215 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Getting quotas for user 2decc2b4793f4b2297d6da0b32eb512e and project cbeaefc57cd14db6ba982fc059b70b70. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:55:06.342626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:55:06.346180 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:55:06.435883 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4e4e5931-b246-4d2f-85b6-088008eb8ac9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.832841 Jun 21 05:55:06.436828 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 95/194] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:55:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:55:06.447442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:06.448391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:06.459119 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.459813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.460762 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.461337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.563956 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ffda4287-6fda-4afd-8398-1a5378b9406e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "POST /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504096 Jun 21 05:55:06.566922 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 100/195] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:55:06 2022] POST /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:06.580104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:06.581616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:06.599139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.599541 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.600360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.600746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.779489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:06.787677 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c4367702-02e5-4134-bce0-51e3071cbd39 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1558 microversion: 2.1 time: 0.344430 Jun 21 05:55:06.792411 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 96/196] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:06 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1558 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:06.798125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0e04a866-ab6e-4e50-8263-9a2ad51c03c3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:06.798729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0e04a866-ab6e-4e50-8263-9a2ad51c03c3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:06.952564 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0e04a866-ab6e-4e50-8263-9a2ad51c03c3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:06.962733 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0e04a866-ab6e-4e50-8263-9a2ad51c03c3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1214 microversion: 2.1 time: 0.169124 Jun 21 05:55:06.963538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 97/197] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:06 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:06.970021 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:06.970801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:06.971573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:06.979948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-81c89ad0-856a-45f2-b203-24df538ca031 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.411420 Jun 21 05:55:06.980712 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 101/198] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:06 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:06.981545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.982440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.983718 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.984342 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.988763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:06.989322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:06.997286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.998057 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:06.999276 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:06.999873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:07.399657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-868ce83e-4135-4cfe-a7da-7631a384a791 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.417675 Jun 21 05:55:07.400961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 102/199] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:55:06 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-interface => generated 284 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:07.602303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:07.617556 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:07.621022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:07.623656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-17e1ec72-cecd-49df-97ce-39facd8e0997 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.658460 Jun 21 05:55:07.624606 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 98/200] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:06 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:55:07.989042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:07.990389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:07.997881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:07.998849 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:08.008871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.010970 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.011583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:08.012241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:08.013795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.015029 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.015635 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:08.016275 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:08.205757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:08.214348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4e08dc1a-7316-460b-a105-54eb01f24ef3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1218 microversion: 2.1 time: 0.229861 Jun 21 05:55:08.218726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 103/201] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:07 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1218 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:08.308683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-79d441e8-98c4-4ce5-a504-b9f20f83dded req-3fe2455f-af75-48e6-b1c2-5faf8aec1a30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a038cbd5-199a-4273-8ded-1fd9a3528a0e", "tag": "34000dbd-bc1c-43fa-96d9-b96ba4703a5f"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:08.326438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-79d441e8-98c4-4ce5-a504-b9f20f83dded req-3fe2455f-af75-48e6-b1c2-5faf8aec1a30 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.327362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-79d441e8-98c4-4ce5-a504-b9f20f83dded req-3fe2455f-af75-48e6-b1c2-5faf8aec1a30 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:08.349308 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-79d441e8-98c4-4ce5-a504-b9f20f83dded req-3fe2455f-af75-48e6-b1c2-5faf8aec1a30 service nova] Creating event network-changed:34000dbd-bc1c-43fa-96d9-b96ba4703a5f for instance a038cbd5-199a-4273-8ded-1fd9a3528a0e on hv-cinder-84690 Jun 21 05:55:08.357507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-79d441e8-98c4-4ce5-a504-b9f20f83dded req-3fe2455f-af75-48e6-b1c2-5faf8aec1a30 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052654 Jun 21 05:55:08.359550 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 104/202] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:08.594801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:08.607765 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1e87554d-4751-4a77-b419-a0da04b4eeaa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1321 microversion: 2.1 time: 0.614426 Jun 21 05:55:08.611587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 99/203] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:07 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:08.646301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:08.647012 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:08.658298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.659846 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:08.660649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:08.662037 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.114038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:09.124199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:09.128910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:09.130109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8e3f0602-593e-400d-baac-c927c0351298 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1407 microversion: 2.20 time: 0.489279 Jun 21 05:55:09.144290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 105/204] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:08 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:55:09.239766 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:09.244047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:09.266720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.268737 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.271796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.273608 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.444223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:09.457892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e63dcd60-87ef-4333-99ac-982f65b1d4f6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1210 microversion: 2.1 time: 0.225044 Jun 21 05:55:09.458753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 100/205] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:09 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1210 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:09.628001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:09.628664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:09.635896 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.639289 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.644165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.647073 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.761912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-c2469e87-f246-4e6e-8e68-bfcf4696fe8b req-c8b864ff-ff12-47b1-bd33-8383491b2a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598a1303-6c97-4b4d-832a-81f96b131503", "tag": "6a306a06-4c23-4c15-b5bb-522ebc76e824"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:09.777019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-c2469e87-f246-4e6e-8e68-bfcf4696fe8b req-c8b864ff-ff12-47b1-bd33-8383491b2a7c service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.782295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-c2469e87-f246-4e6e-8e68-bfcf4696fe8b req-c8b864ff-ff12-47b1-bd33-8383491b2a7c service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.808413 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-c2469e87-f246-4e6e-8e68-bfcf4696fe8b req-c8b864ff-ff12-47b1-bd33-8383491b2a7c service nova] Creating event network-changed:6a306a06-4c23-4c15-b5bb-522ebc76e824 for instance 598a1303-6c97-4b4d-832a-81f96b131503 on hv-cinder-84690 Jun 21 05:55:09.815979 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-c2469e87-f246-4e6e-8e68-bfcf4696fe8b req-c8b864ff-ff12-47b1-bd33-8383491b2a7c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057153 Jun 21 05:55:09.817461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 101/206] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:55:09.895617 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:09.916364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-52933d61-aca2-4b86-8c73-b520dba6923b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1516 microversion: 2.1 time: 0.291989 Jun 21 05:55:09.917326 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 106/207] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:09 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:09.934931 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:09.936089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:09.948681 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.949156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:09.951808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:09.952333 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.090443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'flavor' on Instance uuid 4aa48120-9328-4812-bcaa-9f731723b815 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:55:10.152839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:10.153552 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:10.175921 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.176365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.177148 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.177581 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.316933 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6465b545-9622-416b-97b9-7c37bf875865 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815/action" status: 200 len: 32 microversion: 2.1 time: 0.385078 Jun 21 05:55:10.317610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 102/208] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:55:09 2022] POST /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815/action => generated 32 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 05:55:10.334788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:10.335936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:10.345466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.345648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.346646 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.347150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.449085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:10.474539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:10.482165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:10.483816 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ac530e22-5615-4a73-9b1c-421c3555ca05 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1598 microversion: 2.20 time: 0.339318 Jun 21 05:55:10.484866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 107/209] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:55:10 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1598 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:55:10.493409 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:10.494269 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:10.506084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.506621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.508023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.508465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.605597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:10.608870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:10.616314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-545b279b-aba0-4478-bd5b-474a48d288c0 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1266 microversion: 2.1 time: 0.130131 Jun 21 05:55:10.616577 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8c93a7b0-3121-44de-a1fa-226c68739131 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.293652 Jun 21 05:55:10.616923 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 108/210] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:10 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:10.626904 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 103/211] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:10 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:10.627085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:10.627625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:10.633852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.634359 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.635148 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:10.635550 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:10.717011 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9350996b-5cd4-43e8-9d84-4ff95832f05a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098787 Jun 21 05:55:10.723327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 109/212] 10.222.0.18 () {60 vars in 1315 bytes} [Tue Jun 21 05:55:10 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:55:11.645142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:11.647508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:11.648122 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:11.651605 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:11.662746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:11.663192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:11.663981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:11.664412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:11.665850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:11.666327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:11.667324 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:11.668355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:11.756859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:11.769476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-00b24640-14bb-422f-ae60-18f9a40ad97c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1266 microversion: 2.1 time: 0.138203 Jun 21 05:55:11.770854 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 104/213] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:11 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:11.889479 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:11.901567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-01c32ec3-dadc-4875-b6d9-a498f5e9063a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.268329 Jun 21 05:55:11.902792 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 110/214] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:11 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:12.054799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-bb21abe5-cab3-4a46-882c-393c170a872a req-52084e00-f2fd-4509-a308-5e577fb8bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:12.077472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-bb21abe5-cab3-4a46-882c-393c170a872a req-52084e00-f2fd-4509-a308-5e577fb8bb4e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:12.078271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-bb21abe5-cab3-4a46-882c-393c170a872a req-52084e00-f2fd-4509-a308-5e577fb8bb4e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:12.107340 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-bb21abe5-cab3-4a46-882c-393c170a872a req-52084e00-f2fd-4509-a308-5e577fb8bb4e service nova] Creating event network-changed:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:55:12.118197 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-bb21abe5-cab3-4a46-882c-393c170a872a req-52084e00-f2fd-4509-a308-5e577fb8bb4e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068774 Jun 21 05:55:12.118656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 105/215] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:12.792777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:12.793551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:12.800346 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:12.800785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:12.801601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:12.802286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:12.868632 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:12.878608 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f5c066e5-38c5-4901-a25d-5b86d54c7feb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1266 microversion: 2.1 time: 0.090640 Jun 21 05:55:12.879843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 111/216] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:12 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:12.923913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:12.923913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:12.931762 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:12.932276 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:12.933392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:12.933726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:13.111768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:13.122766 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-53dc7d1a-fc95-4faf-9d0b-9d426b8c9f03 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.206374 Jun 21 05:55:13.123566 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 106/217] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:12 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:13.899821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:13.900564 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:13.907874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:13.908318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:13.909087 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:13.909519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:13.975234 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:13.987590 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-61b98e74-aa67-43b5-b629-10a82e84871a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1266 microversion: 2.1 time: 0.093264 Jun 21 05:55:13.988502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 112/218] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:13 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:14.140629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:14.141239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:14.147719 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:14.148154 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:14.148925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:14.149343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:14.288525 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:14.296144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3c5ac2cb-f4ea-406c-aa1f-95ee73b1577a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.159819 Jun 21 05:55:14.296713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 107/219] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:14 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:15.005739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:15.006342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:15.014040 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.019163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.020576 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.021087 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.171120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:15.182961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c685bbb3-7982-405a-9bea-f9cd42ec0226 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1284 microversion: 2.1 time: 0.182059 Jun 21 05:55:15.183567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 113/220] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:14 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:15.318256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:15.319037 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:15.327451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.328114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.329377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.330227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.591097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:15.598211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:15.609539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.609998 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.613093 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.613866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.676664 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:15.683573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7091e409-2ba2-44ce-beac-012dfedb4de3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.374511 Jun 21 05:55:15.684159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 108/221] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:15 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:15.689562 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:55:15.716953 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:15.851247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:15.858912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-47fd0112-59fb-41db-9df9-f12553aebe33 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "DELETE /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 204 len: 0 microversion: 2.1 time: 0.271380 Jun 21 05:55:15.861555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 114/222] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:55:15 2022] DELETE /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 05:55:15.879051 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:15.885782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:15.893673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.894373 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:15.895737 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:15.896319 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:16.126830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:16.136948 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c375d424-c946-4701-ba7f-f1691e8b6656 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1553 microversion: 2.1 time: 0.265946 Jun 21 05:55:16.138321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 109/223] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:15 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:16.201427 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:16.202253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:16.209335 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:16.209776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:16.210626 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:16.211333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:16.339955 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:16.347438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4e0361df-90d5-4edc-b8a6-30a2f616faa6 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.150714 Jun 21 05:55:16.348016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 115/224] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:16 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:16.700665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:16.701218 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:16.703280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:16.708741 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:16.709177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:16.710187 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:16.710618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:16.839658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:16.847463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fe957923-d1ba-44dc-90d4-915ab2b38f68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.150594 Jun 21 05:55:16.847824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 110/225] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:16 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:17.155822 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:17.156423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:17.162869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:17.163327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:17.164093 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:17.164524 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:17.302596 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:17.310402 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b1174004-5f60-47e3-97fa-581ac87da18e tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1553 microversion: 2.1 time: 0.159086 Jun 21 05:55:17.310950 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 116/226] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:17 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:17.364449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:17.365059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:17.366914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=8 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:17.372203 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:17.372650 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:17.373401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:17.373832 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:17.496635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:17.503996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fa719c36-e55d-4ff6-a8fc-c8c2fb85e0ce tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.143410 Jun 21 05:55:17.504554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 111/227] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:17 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:17.865627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:17.866532 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:17.875814 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:17.876257 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:17.877854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:17.877854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:18.013803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:18.021840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-70e52633-7e9c-42c3-a045-11b4fcca488d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.160717 Jun 21 05:55:18.022440 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 117/228] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:17 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:18.327411 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:18.328015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:18.334158 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:18.334604 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:18.335391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:18.335825 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:18.467942 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:18.471430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:18.476986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-dba7e033-8fa8-4bb3-a26b-b04981674c53 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1553 microversion: 2.1 time: 0.153512 Jun 21 05:55:18.477571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 112/229] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:18 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:18.521327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:18.521893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:18.528903 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:18.529371 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:18.530162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:18.530591 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:18.669341 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:18.677127 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5c76c3c4-bb33-452e-940c-afcab399207f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.159791 Jun 21 05:55:18.677698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 118/230] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:18 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:19.039307 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:19.039905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:19.046469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:19.046932 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:19.047675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:19.048110 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:19.177023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:19.186375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-39a2b12b-c426-4346-b311-a704e4d71759 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.151445 Jun 21 05:55:19.186964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 113/231] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:19 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:19.495229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:19.496561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:19.505367 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:19.506184 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:19.506908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:19.507560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:19.698808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:19.700134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:19.718764 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:19.720763 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:19.721884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:19.722439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:19.740206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:19.759646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2b9a091e-f529-4445-ae1a-ce624f5ee256 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1553 microversion: 2.1 time: 0.268593 Jun 21 05:55:19.765871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 119/232] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:19 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:20.000414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:20.016029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8e217db0-cd3e-47e7-a935-d98eb7f44889 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.325977 Jun 21 05:55:20.020612 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 114/233] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:19 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:20.206554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-a46d4092-a7da-4037-a253-0854f7856e5c req-5a363c4d-25a6-4507-9052-abd7c2489403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ef7f692-5104-495d-8450-a3be2804f52a", "tag": "2c564256-98ef-4e07-b576-771aee33d26e"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:20.207748 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:20.208365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:20.220848 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:20.223819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:20.224645 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:20.225074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:20.232491 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a46d4092-a7da-4037-a253-0854f7856e5c req-5a363c4d-25a6-4507-9052-abd7c2489403 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:20.233356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a46d4092-a7da-4037-a253-0854f7856e5c req-5a363c4d-25a6-4507-9052-abd7c2489403 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:20.255178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-a46d4092-a7da-4037-a253-0854f7856e5c req-5a363c4d-25a6-4507-9052-abd7c2489403 service nova] Creating event network-changed:2c564256-98ef-4e07-b576-771aee33d26e for instance 4ef7f692-5104-495d-8450-a3be2804f52a on hv-cinder-84690 Jun 21 05:55:20.260856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-a46d4092-a7da-4037-a253-0854f7856e5c req-5a363c4d-25a6-4507-9052-abd7c2489403 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063674 Jun 21 05:55:20.261849 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 120/234] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:55:20.460850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:20.469259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f1af8239-6edd-4ab8-b1b7-7ece75f8810d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.270130 Jun 21 05:55:20.469852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 115/235] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:20 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:20.666587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-0f07fbb4-0552-430f-8e48-f7d88c056933 req-68266399-cedb-4e50-bfbd-a27bb3d2cec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be655d46-baab-49d2-842e-55873b5e4e91", "name": "network-vif-deleted", "tag": "3b55b939-e669-4c15-98a5-c5175355b381"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:20.675014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-0f07fbb4-0552-430f-8e48-f7d88c056933 req-68266399-cedb-4e50-bfbd-a27bb3d2cec6 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:20.675471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-0f07fbb4-0552-430f-8e48-f7d88c056933 req-68266399-cedb-4e50-bfbd-a27bb3d2cec6 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:20.687828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-0f07fbb4-0552-430f-8e48-f7d88c056933 req-68266399-cedb-4e50-bfbd-a27bb3d2cec6 service nova] Creating event network-vif-deleted:3b55b939-e669-4c15-98a5-c5175355b381 for instance be655d46-baab-49d2-842e-55873b5e4e91 on hv-cinder-84690 Jun 21 05:55:20.693058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-0f07fbb4-0552-430f-8e48-f7d88c056933 req-68266399-cedb-4e50-bfbd-a27bb3d2cec6 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030862 Jun 21 05:55:20.693676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 121/236] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:20.780720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:20.781352 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:20.784293 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:20.788137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:20.788579 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:20.789343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:20.789776 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:20.851927 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:20.860082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-af18d086-8825-4b66-a82a-02d06a832bf7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1511 microversion: 2.1 time: 0.083163 Jun 21 05:55:20.860947 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 116/237] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:20 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:21.038518 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:21.039155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:21.045799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:21.046258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:21.046997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:21.047420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:21.173286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:21.180736 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-270c79fd-05d6-4c43-97a8-896399cbb0ad tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.146567 Jun 21 05:55:21.181295 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 122/238] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:21 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:21.486242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:21.486844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:21.492847 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:21.493291 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:21.494146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:21.494581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:21.621609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:21.629314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ae3e2cbf-abfb-4d51-8c9a-9590f197b075 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.146771 Jun 21 05:55:21.629795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 117/239] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:21 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:21.879183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:21.879892 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:21.887070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:21.888024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:21.888805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:21.889232 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:21.952555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:21.960501 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1d0bb70f-e2ad-43db-902e-2a1ab3c0e15c tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1511 microversion: 2.1 time: 0.085439 Jun 21 05:55:21.961069 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 123/240] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:21 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:22.198102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:22.198712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:22.205468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:22.205916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:22.206706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:22.207140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:22.339447 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:22.347192 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6bab5776-be20-4189-bbcd-949fa6c07297 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.153294 Jun 21 05:55:22.347754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 118/241] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:22 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:22.646209 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:22.646815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:22.652794 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:22.653250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:22.654009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:22.654441 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:22.789799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:22.797982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-29b4dfdf-f542-467f-bef9-127d9b3c03a5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.155680 Jun 21 05:55:22.798565 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 124/242] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:22 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:22.978728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:22.979271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:22.986011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:22.986450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:22.987195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:22.987620 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:23.047697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:23.055756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-98602401-422d-469f-970d-34e0692603cd tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1511 microversion: 2.1 time: 0.080945 Jun 21 05:55:23.056343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 119/243] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:22 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1511 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:23.364420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:23.365120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:23.371557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:23.371998 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:23.372917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:23.373356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:23.508258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:23.516575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-08141cac-c70e-47fa-b14d-6f78623936b9 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.156128 Jun 21 05:55:23.517135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 125/244] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:23 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:23.815376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:23.815978 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:23.822123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:23.822562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:23.823325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:23.823751 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:23.957387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:23.965508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-99736681-8d8b-4413-a4b7-4ed5b952dc86 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.154031 Jun 21 05:55:23.966225 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 120/245] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:23 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:24.072579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:24.073196 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:24.079601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:24.080071 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:24.080815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:24.081246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:24.153017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:24.161209 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-10d844cd-ef27-4f07-a95f-fe03feb289c2 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1345 microversion: 2.1 time: 0.092492 Jun 21 05:55:24.161784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 126/246] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:24 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:24.535001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:24.535713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:24.543303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:24.543841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:24.545323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:24.545992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:24.818034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:24.825866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4b6d3391-3c65-496f-86cc-35007fbb9773 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.296905 Jun 21 05:55:24.826634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 121/247] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:24 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:24.984904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:24.985520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:24.992093 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:24.992586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:24.993374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:24.994263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:25.182998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:25.185351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:25.192320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:25.193183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:25.194031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:25.194671 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:25.242346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:25.242881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:25.243553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lazy-loading 'fault' on Instance uuid be655d46-baab-49d2-842e-55873b5e4e91 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:55:25.368322 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6924b4015a7495885d168495a5bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c9925a32b094db69c8637996e9cafa1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:25.375819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e5f881ec-723a-4ba7-802f-620a85415ece tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 200 len: 1304 microversion: 2.1 time: 0.199959 Jun 21 05:55:25.376398 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 122/248] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:25 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:25.484900 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:25.494058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-502013f6-48e0-4123-a17b-6c3c836c3448 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.514254 Jun 21 05:55:25.503315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 127/249] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:24 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:25.843786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:25.844394 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:25.850851 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:25.851299 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:25.852073 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:25.852595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:25.992700 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:26.001519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-46c2ce6a-9006-4e0c-b2af-14dc837081c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.162134 Jun 21 05:55:26.002993 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 123/250] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:25 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:26.394703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:26.395302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:26.401919 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:26.402387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:26.403134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:26.403558 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:26.417172 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] HTTP exception thrown: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Request method failure captured: Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 HTTP/1.1 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0AsdqhpBpyaSjrxZ5_AAwGJJfYTUzlYuS5C8YRaRW7v7hgk0jjBoRE3qmoRDbNSc67B-XLaE0jcvVS1j4niR0Qqr2gKHwbZ_dzTjb_c0G7NlkT5Hf8Exp__pURPOsTJkeeLTl0uzQfx0uacL0Fr13-I6fNBDAfYt9NlgKRJKQJDE4 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:55:26.422307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: a6924b4015a7495885d168495a5bfbfc Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.423703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'be655d46-baab-49d2-842e-55873b5e4e91'} Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:55:26.424483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.425744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.426960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Returning 404 to user: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:55:26.426960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2fc692a4-32d9-439a-a7fb-cd89c75563e7 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 404 len: 111 microversion: 2.1 time: 0.032892 Jun 21 05:55:26.426960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 128/251] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:26 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:55:26.510984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:26.511666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:26.517762 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:26.518238 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:26.519003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:26.519435 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:26.540136 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:26.542004 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:26.548967 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:26.549501 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:26.550363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:26.550881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:26.565770 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] HTTP exception thrown: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Request method failure captured: Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91/os-volume_attachments HTTP/1.1 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0AsdqhpBpyaSjrxZ5_AAwGJJfYTUzlYuS5C8YRaRW7v7hgk0jjBoRE3qmoRDbNSc67B-XLaE0jcvVS1j4niR0Qqr2gKHwbZ_dzTjb_c0G7NlkT5Hf8Exp__pURPOsTJkeeLTl0uzQfx0uacL0Fr13-I6fNBDAfYt9NlgKRJKQJDE4 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:55:26.567599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: a6924b4015a7495885d168495a5bfbfc Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.570001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'server_id': 'be655d46-baab-49d2-842e-55873b5e4e91'} Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:55:26.571342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:26.573765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:26.576141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Returning 404 to user: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:55:26.576141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-662e9d40-0880-4999-b9d7-76c2b4dba820 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033925 Jun 21 05:55:26.576141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 129/252] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:55:26 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 05:55:26.662386 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:26.670784 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1a0c1dd5-ebc3-4017-b662-e4351051c9db tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.163750 Jun 21 05:55:26.671359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 124/253] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:26 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:27.019056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:27.019716 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:27.027166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:27.028348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:27.029111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:27.029538 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:27.173970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:27.182068 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cb29df07-b6b6-4eea-adfc-cfddc6f6b052 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.166787 Jun 21 05:55:27.182638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 130/254] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:27 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:27.688660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:27.689313 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:27.695858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:27.696245 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:27.697010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:27.697436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:27.846637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:27.855172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-da04fe86-8d31-4401-a704-bf6c97d21a23 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.170238 Jun 21 05:55:27.856410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 125/255] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:27 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:28.198327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:28.199587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:28.206080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:28.206518 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:28.207267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:28.207689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:28.344102 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:28.353421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9ec70f98-fd0f-46b3-ab32-183f421e5d33 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.158769 Jun 21 05:55:28.354025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 131/256] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:28 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:28.873603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:28.874374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:28.880443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:28.881010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:28.881853 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:28.882484 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.020120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:29.027777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4b92f0ef-07f1-4048-b3ed-03a997188da7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.158576 Jun 21 05:55:29.028379 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 126/257] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:28 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:29.373140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:29.373847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:29.380870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:29.381616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.382097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:29.382522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.525203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:29.528784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:29.534487 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0cf9668d-f725-46a0-8f95-9761de472a06 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.166768 Jun 21 05:55:29.535483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 132/258] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:29 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:29.883992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:29.883992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:29.890378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:29.890735 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.891526 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:29.891980 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.906721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] HTTP exception thrown: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Request method failure captured: Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 HTTP/1.1 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0AsdqhpBpyaSjrxZ5_AAwGJJfYTUzlYuS5C8YRaRW7v7hgk0jjBoRE3qmoRDbNSc67B-XLaE0jcvVS1j4niR0Qqr2gKHwbZ_dzTjb_c0G7NlkT5Hf8Exp__pURPOsTJkeeLTl0uzQfx0uacL0Fr13-I6fNBDAfYt9NlgKRJKQJDE4 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:55:29.914239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: a6924b4015a7495885d168495a5bfbfc Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.915611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'be655d46-baab-49d2-842e-55873b5e4e91'} Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:55:29.916439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.917753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.919711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Returning 404 to user: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:55:29.919711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f85da90c-02f7-4012-b2f2-c0a1b2791247 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "DELETE /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 404 len: 111 microversion: 2.1 time: 0.033988 Jun 21 05:55:29.919711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 127/259] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:55:29 2022] DELETE /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:55:29.922431 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:29.923033 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] [instance: be655d46-baab-49d2-842e-55873b5e4e91] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:29.931084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:29.931687 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.932447 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:29.932867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:29.948723 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] HTTP exception thrown: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Request method failure captured: Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 HTTP/1.1 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0AsdqhpBpyaSjrxZ5_AAwGJJfYTUzlYuS5C8YRaRW7v7hgk0jjBoRE3qmoRDbNSc67B-XLaE0jcvVS1j4niR0Qqr2gKHwbZ_dzTjb_c0G7NlkT5Hf8Exp__pURPOsTJkeeLTl0uzQfx0uacL0Fr13-I6fNBDAfYt9NlgKRJKQJDE4 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:55:29.950294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9c9925a32b094db69c8637996e9cafa1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9c9925a32b094db69c8637996e9cafa1 Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-DeleteServersTestJSON-903632440 Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: a6924b4015a7495885d168495a5bfbfc Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-DeleteServersTestJSON-903632440-project Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.951675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'be655d46-baab-49d2-842e-55873b5e4e91'} Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:55:29.952465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. Jun 21 05:55:29.953805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:29.954785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] Returning 404 to user: Instance be655d46-baab-49d2-842e-55873b5e4e91 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:55:29.954785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2ff5de69-e607-4b65-9042-d9c9f46455f5 tempest-DeleteServersTestJSON-903632440 tempest-DeleteServersTestJSON-903632440-project] 10.222.0.18 "GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91" status: 404 len: 111 microversion: 2.1 time: 0.033675 Jun 21 05:55:29.954785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 133/260] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:29 2022] GET /compute/v2.1/servers/be655d46-baab-49d2-842e-55873b5e4e91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:55:30.044483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:30.047417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:30.055303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:30.055754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:30.056520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:30.056947 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:30.282692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:30.291133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cd72e0e7-2d21-431a-9957-1a365cad132f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.250549 Jun 21 05:55:30.291805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 128/261] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:30 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:30.552703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:30.554011 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:30.562172 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:30.562522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:30.563418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:30.564128 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:30.831128 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:30.842175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-08941f4d-d978-4875-a6ad-4d2a218fceeb tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.293204 Jun 21 05:55:30.842899 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 134/262] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:30 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:31.308885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:31.317414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:31.324094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:31.324567 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:31.325353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:31.326048 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:31.557510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-d9472a75-66fc-4c6e-952d-8f09e44ea332 req-42d6542c-2797-4602-b8ea-d69d6d61baac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef7f692-5104-495d-8450-a3be2804f52a", "name": "network-vif-plugged", "status": "completed", "tag": "2c564256-98ef-4e07-b576-771aee33d26e"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:31.569149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-d9472a75-66fc-4c6e-952d-8f09e44ea332 req-42d6542c-2797-4602-b8ea-d69d6d61baac service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:31.569761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-d9472a75-66fc-4c6e-952d-8f09e44ea332 req-42d6542c-2797-4602-b8ea-d69d6d61baac service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:31.593295 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-d9472a75-66fc-4c6e-952d-8f09e44ea332 req-42d6542c-2797-4602-b8ea-d69d6d61baac service nova] Creating event network-vif-plugged:2c564256-98ef-4e07-b576-771aee33d26e for instance 4ef7f692-5104-495d-8450-a3be2804f52a on hv-cinder-84690 Jun 21 05:55:31.604181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-d9472a75-66fc-4c6e-952d-8f09e44ea332 req-42d6542c-2797-4602-b8ea-d69d6d61baac service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050165 Jun 21 05:55:31.606572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 135/263] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:55:31.861253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:31.861760 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:31.878623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:31.879084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:31.879860 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:31.880311 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:31.942551 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:31.946308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:31.951358 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fef304cf-792d-4b68-b698-46e550030aed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.647036 Jun 21 05:55:31.951936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 129/264] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:31 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:32.297094 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:32.315968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-78b5eabd-ee8a-4ea1-bd71-f51ff739b122 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.458895 Jun 21 05:55:32.326685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 136/265] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:31 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:32.971412 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:32.972612 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:32.981092 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:32.981834 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:32.982873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:32.983317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:33.334124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:33.338662 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:33.348935 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:33.355893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:33.356340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:33.357118 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:33.357545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:33.370036 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-97ff7453-4a7b-46dc-ad33-5d52566e61fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.402428 Jun 21 05:55:33.391439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 130/266] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:32 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:33.588327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:33.599510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f6f2be2d-17ea-43d2-b87e-1d2161a0f9ef tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1314 microversion: 2.1 time: 0.269243 Jun 21 05:55:33.600270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 137/267] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:33 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:34.397791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:34.398996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:34.406372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:34.406880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:34.407648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:34.408079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:34.585588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:34.600028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-619babe2-e4ad-4906-a8b7-3a19a9a225d4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.207048 Jun 21 05:55:34.601901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 131/268] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:34 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:34.617529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:34.619389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:34.628191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:34.629021 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:34.630520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:34.631433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:34.863052 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:34.875726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f3563072-c8d0-43a0-be68-a3a4e91b709f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1497 microversion: 2.1 time: 0.262616 Jun 21 05:55:34.876479 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 138/269] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:34 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1497 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:35.481623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:35.482317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:35.490337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:35.490789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:35.491703 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:35.492271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:35.542134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:55:35.622897 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:35.625642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:35.640683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:35.641762 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:35.649108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:35.650191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:35.692862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-db5dbbac-8d7b-46c8-a3ce-e7cb247fe35a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 204 len: 0 microversion: 2.1 time: 0.216880 Jun 21 05:55:35.693474 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 132/270] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:55:35 2022] DELETE /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:55:35.715912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:35.716654 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:35.722660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:35.723638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:35.724573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:35.725205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:35.957102 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:35.959948 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:35.968791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d55f23d5-0351-44b8-a3dd-67b63cce0ad3 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1503 microversion: 2.1 time: 0.270052 Jun 21 05:55:35.969597 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 133/271] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:35 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:35.975542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-acf743bf-f9b4-4917-be2b-010378442268 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.360629 Jun 21 05:55:35.976893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 139/272] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:35 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:36.991927 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:36.995401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:36.996426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:36.997241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:37.010772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:37.011778 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:37.011962 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:37.012499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:37.013670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:37.013789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:37.014445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:37.014825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:37.342424 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:37.356181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:37.356451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4c9725f3-2728-42c4-a1c8-618463696944 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.363719 Jun 21 05:55:37.357601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 140/273] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:36 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:37.366607 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d5a13cac-b85f-4eee-a8af-6d30a04e232d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1503 microversion: 2.1 time: 0.381794 Jun 21 05:55:37.367745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 134/274] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:36 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:38.373505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:38.375166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:38.381776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:38.382743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:38.384321 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:38.385163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:38.388862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:38.389466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:38.396989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:38.397376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:38.404045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:38.404045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:38.631594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:38.641094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7dcc9703-908d-4c81-9491-786f73717a32 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 200 len: 1461 microversion: 2.1 time: 0.258950 Jun 21 05:55:38.641670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 135/275] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:38 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 1461 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:38.761167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:38.769791 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5279e51b-a0e4-4a46-9097-174bb5252681 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.400696 Jun 21 05:55:38.771391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-823e5b49-3342-4043-a442-809be1a5ab0f req-c38fab8d-6334-41d4-b2df-05a8c4fcd24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ef7f692-5104-495d-8450-a3be2804f52a", "name": "network-vif-deleted", "tag": "2c564256-98ef-4e07-b576-771aee33d26e"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:38.773458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 141/276] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:38 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:38.784736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-823e5b49-3342-4043-a442-809be1a5ab0f req-c38fab8d-6334-41d4-b2df-05a8c4fcd24b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:38.788694 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-823e5b49-3342-4043-a442-809be1a5ab0f req-c38fab8d-6334-41d4-b2df-05a8c4fcd24b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:38.813459 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-823e5b49-3342-4043-a442-809be1a5ab0f req-c38fab8d-6334-41d4-b2df-05a8c4fcd24b service nova] Creating event network-vif-deleted:2c564256-98ef-4e07-b576-771aee33d26e for instance 4ef7f692-5104-495d-8450-a3be2804f52a on hv-cinder-84690 Jun 21 05:55:38.823112 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-823e5b49-3342-4043-a442-809be1a5ab0f req-c38fab8d-6334-41d4-b2df-05a8c4fcd24b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057797 Jun 21 05:55:38.824073 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 136/277] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:55:39.658493 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:39.659115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 4ef7f692-5104-495d-8450-a3be2804f52a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:39.665853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:39.666417 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:39.667428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:39.670457 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:39.689818 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] HTTP exception thrown: Instance 4ef7f692-5104-495d-8450-a3be2804f52a could not be found. Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Request method failure captured: Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a HTTP/1.1 Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV03frRctL5UQWczJq4Hh6xG5nyc1qWRU6neY6W0jJwnZ_9aafEQYFMflZRyQ818JVC2Vj1Bdqmhwex9xuSYAmXPhSHBpfTNgc4aAXhPp9vDcjXGyfNKjCLRSGuT1p3CwqBLf6BQzVEGFmiBdR3ciKuK_i6XHsYuABGd5FfxrhR_qyY Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: cbeaefc57cd14db6ba982fc059b70b70 Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesActionsTest-1937324591 Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:55:39.691436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesActionsTest-1937324591 Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: cbeaefc57cd14db6ba982fc059b70b70 Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesActionsTest-1937324591 Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesActionsTest-1937324591-project Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 2decc2b4793f4b2297d6da0b32eb512e Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesActionsTest-1937324591-project Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 4ef7f692-5104-495d-8450-a3be2804f52a could not be found. Jun 21 05:55:39.692685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '4ef7f692-5104-495d-8450-a3be2804f52a'} Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ef7f692-5104-495d-8450-a3be2804f52a could not be found. Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:55:39.694366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ef7f692-5104-495d-8450-a3be2804f52a could not be found. Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ef7f692-5104-495d-8450-a3be2804f52a could not be found. Jun 21 05:55:39.695637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:55:39.696640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Returning 404 to user: Instance 4ef7f692-5104-495d-8450-a3be2804f52a could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:55:39.696640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b15d24c7-cf75-427e-ac1d-e4aa42d5b80d tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a" status: 404 len: 111 microversion: 2.1 time: 0.038253 Jun 21 05:55:39.696640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 142/278] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:39 2022] GET /compute/v2.1/servers/4ef7f692-5104-495d-8450-a3be2804f52a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:55:39.798098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:39.798916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:39.810294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:39.810294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:39.810294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:39.810294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:39.811121 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-477928401", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "networks": [{"uuid": "384d9f09-0db5-4d95-aab9-02eb51e6286a"}]}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:39.880737 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] validate_networks() for [('384d9f09-0db5-4d95-aab9-02eb51e6286a', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:55:40.298910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:40.309445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cd672383-3401-4e47-bb66-cbb26c92e6e0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.516563 Jun 21 05:55:40.310541 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 137/279] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:39 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:40.742121 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:55:40.742835 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:55:40.743161 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:55:40.743551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:55:40.746224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:55:40.763899 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:40.764698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:40.765787 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:40.766525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:40.794103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Getting quotas for project cbeaefc57cd14db6ba982fc059b70b70. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:55:40.800272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Getting quotas for user 2decc2b4793f4b2297d6da0b32eb512e and project cbeaefc57cd14db6ba982fc059b70b70. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:55:40.815846 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:55:40.818372 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:55:40.878334 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fe36770d-8801-479f-be24-e59d55f90b61 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071681 Jun 21 05:55:40.884947 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 143/280] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 05:55:40.890259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-142d2d56-9f29-46a8-b3cb-3ea1424dc325 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:40.891844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-142d2d56-9f29-46a8-b3cb-3ea1424dc325 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:41.005656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-142d2d56-9f29-46a8-b3cb-3ea1424dc325 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:41.015144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-142d2d56-9f29-46a8-b3cb-3ea1424dc325 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1213 microversion: 2.1 time: 0.129409 Jun 21 05:55:41.016032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 138/281] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:40 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1213 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:41.327182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:41.330478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:41.339053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:41.339542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:41.340340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:41.340776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:41.503510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:41.511337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1fe1b2f0-b977-4fc0-9d60-b99ce7b83f9d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.188209 Jun 21 05:55:41.512415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 144/282] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:41 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:42.047258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:42.047977 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:42.068261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:42.069636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:42.071201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:42.071923 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:42.210890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:42.227785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b2d41be3-3441-4301-8841-8ed6e9bc2979 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1273 microversion: 2.1 time: 0.197560 Jun 21 05:55:42.229383 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 139/283] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:42 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:42.536083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:42.540030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:42.551055 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:42.552411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:42.554149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:42.555267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:42.836089 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:42.846719 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-721dfc03-8285-4a0d-a60c-9acf973dac96 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.318913 Jun 21 05:55:42.847304 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 145/284] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:42 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:43.259118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:43.260176 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:43.282390 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:43.283428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:43.285455 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:43.286551 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:43.824016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:43.837259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-dd15dc63-91fe-4982-ad5a-9918414221f4 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.588550 Jun 21 05:55:43.838676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 140/285] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:43 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:43.873394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:43.874680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:43.888330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:43.888970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:43.890339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:43.891155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:44.195915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:44.212079 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7c63d428-d1c8-4898-a95f-e854f2c2d3b7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.348118 Jun 21 05:55:44.213086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 146/286] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:43 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:44.392652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-d9b62a35-e499-4d0b-b955-20678842b4b2 req-99c73e6e-41cd-48e3-84ad-6a58dbeeff2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24915532-1e10-4632-9b04-93b4c32ee970", "tag": "fb2f74d9-9027-457c-9a77-fc0a5b21bbe0"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:44.429359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-d9b62a35-e499-4d0b-b955-20678842b4b2 req-99c73e6e-41cd-48e3-84ad-6a58dbeeff2e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:44.430053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-d9b62a35-e499-4d0b-b955-20678842b4b2 req-99c73e6e-41cd-48e3-84ad-6a58dbeeff2e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:44.452865 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-d9b62a35-e499-4d0b-b955-20678842b4b2 req-99c73e6e-41cd-48e3-84ad-6a58dbeeff2e service nova] Creating event network-changed:fb2f74d9-9027-457c-9a77-fc0a5b21bbe0 for instance 24915532-1e10-4632-9b04-93b4c32ee970 on hv-cinder-84690 Jun 21 05:55:44.463952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-d9b62a35-e499-4d0b-b955-20678842b4b2 req-99c73e6e-41cd-48e3-84ad-6a58dbeeff2e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080190 Jun 21 05:55:44.465631 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 141/287] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:55:44.863269 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:44.863879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:44.880789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:44.881433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:44.882648 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:44.885715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:45.132966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:45.145775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-94c11bb4-2ae8-4323-abf5-46a36de9e0fe tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.287016 Jun 21 05:55:45.146375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 147/288] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:44 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:45.239705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:45.240809 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:45.249201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:45.249905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:45.250885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:45.251476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:45.408488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:45.420858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b5e3693e-59ce-4532-beaf-c29915ae9be5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.186213 Jun 21 05:55:45.421789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 142/289] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:45 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:46.164953 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:46.165587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:46.172813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:46.173266 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:46.174112 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:46.177007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:46.448283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:46.451355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:46.485024 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:46.486481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:46.490815 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:46.491480 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:46.543844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:46.570610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a2ba97ed-d7d1-44cc-af61-af2b068270c1 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.402309 Jun 21 05:55:46.570610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 148/290] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:46 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:47.009957 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:47.023397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e0f71607-999e-4ec8-96a4-a1990442e640 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.582529 Jun 21 05:55:47.024761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 143/291] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:46 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:47.586658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:47.586658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:47.593977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:47.596901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:47.598000 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:47.600277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:47.600560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:47.836421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:47.850900 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-27eda47c-5f5b-42b8-bb4d-14088d7f6fbc tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.273089 Jun 21 05:55:47.852379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 149/292] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:47 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:48.042242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:48.042787 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:48.050300 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:48.050819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:48.051813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:48.052394 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:48.297188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:48.314293 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a6aed268-3cc5-4334-90a5-cb29a73a9fa3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.275807 Jun 21 05:55:48.330696 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 144/293] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:48 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:48.875805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:48.876627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:48.887153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:48.887885 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:48.889152 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:48.889765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:49.149895 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:49.166793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-84199e44-2002-455d-b545-6aece955661f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.295999 Jun 21 05:55:49.169066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 150/294] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:48 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:49.349303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:49.350565 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:49.364437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:49.365849 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:49.367426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:49.368064 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:49.603386 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:49.617600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2692d19b-3b5b-446a-8269-c8c8eb7e121b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.279964 Jun 21 05:55:49.618742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 145/295] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:49 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:50.196343 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:50.197332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:50.209006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:50.210261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:50.212796 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:50.213377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:50.384095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:50.395800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-80008336-b658-4cbc-8ddf-fc3fff6592a5 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.204154 Jun 21 05:55:50.396808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 151/296] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:50 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:50.640566 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:50.642283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:50.650432 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:50.650884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:50.651666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:50.652112 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:50.829444 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:50.845414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-40febb3e-f5ed-4ed7-8f2e-8aba7dbc0c44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.209830 Jun 21 05:55:50.852581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 146/297] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:50 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:51.416540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:51.417767 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:51.420110 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.421151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=6 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.436984 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:51.437885 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:51.439459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:51.440471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:51.455246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.629175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:51.639782 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-01bdcf1e-2020-4327-b3ca-9926b6f7341f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.227332 Jun 21 05:55:51.640352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 152/298] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:51 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:51.868791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:51.869488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:51.871637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.872356 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:51.878704 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:51.878995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:51.879875 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:51.880311 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:51.886171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:55:52.024415 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:52.032848 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-27646257-4860-4d19-b237-f6babd786813 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.167952 Jun 21 05:55:52.033652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 147/299] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:51 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:52.184203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-d35b56f4-f725-4a6d-8031-4fcadbb4d726 req-f5099f14-79ec-4b94-a676-7eb7659665b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24915532-1e10-4632-9b04-93b4c32ee970", "name": "network-vif-plugged", "status": "completed", "tag": "fb2f74d9-9027-457c-9a77-fc0a5b21bbe0"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:55:52.199149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-d35b56f4-f725-4a6d-8031-4fcadbb4d726 req-f5099f14-79ec-4b94-a676-7eb7659665b2 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:52.200340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-d35b56f4-f725-4a6d-8031-4fcadbb4d726 req-f5099f14-79ec-4b94-a676-7eb7659665b2 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:52.217141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-d35b56f4-f725-4a6d-8031-4fcadbb4d726 req-f5099f14-79ec-4b94-a676-7eb7659665b2 service nova] Creating event network-vif-plugged:fb2f74d9-9027-457c-9a77-fc0a5b21bbe0 for instance 24915532-1e10-4632-9b04-93b4c32ee970 on hv-cinder-84690 Jun 21 05:55:52.224073 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-d35b56f4-f725-4a6d-8031-4fcadbb4d726 req-f5099f14-79ec-4b94-a676-7eb7659665b2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047119 Jun 21 05:55:52.225274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 153/300] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:55:52.659092 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:52.659774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:52.666666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:52.667736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:52.668521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:52.669056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:52.846647 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:52.855253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b87e1904-ea7d-4a54-94c3-030de202ae5b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.201775 Jun 21 05:55:52.855830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 148/301] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:52 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:53.051527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:53.052338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:53.059570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:53.060172 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:53.060935 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:53.061460 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:53.206890 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:53.215641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-26455f5f-c19a-4f6a-9b45-36085e179c8f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.169151 Jun 21 05:55:53.216390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 154/302] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:53 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:53.873545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:53.874212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:53.881143 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:53.881649 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:53.882690 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:53.883271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:54.056011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:54.065713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e3a75393-7906-4427-9f38-b011309be1cf tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1313 microversion: 2.1 time: 0.196811 Jun 21 05:55:54.066791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 149/303] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:53 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:54.233813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:54.234396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:54.241227 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:54.241847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:54.242607 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:54.243197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:54.396276 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:54.404997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-20ad04ce-6706-4088-a289-733e892417fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.175663 Jun 21 05:55:54.405567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 155/304] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:54 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:55.083385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:55.084119 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:55.091332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:55.091660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:55.092527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:55.093031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:55.242358 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:55.252953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d8b1ac3d-f5ef-4dda-8941-6e896af05ef8 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1496 microversion: 2.1 time: 0.173353 Jun 21 05:55:55.264721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 150/305] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:55 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:55.424533 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:55.425095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:55.438430 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:55.438880 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:55.439669 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:55.440092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:55.667354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:55.676539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0e0d522b-39f7-4845-bd03-db6a261e160a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.258442 Jun 21 05:55:55.677455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 156/306] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:55 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:55.902841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:55.902841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:55.908992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:55.909436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:55.910234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:55.910663 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:55.937094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:55:56.027479 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-295b76d5-c92b-419a-924c-8ae574f530b7 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 204 len: 0 microversion: 2.1 time: 0.128825 Jun 21 05:55:56.028303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 151/307] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:55:55 2022] DELETE /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:55:56.036255 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:56.036996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:56.045244 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:56.045693 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:56.046612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:56.046942 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:56.185555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:56.193366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fb06c29f-f30c-4c19-9c65-4e25e1d07a8c tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1502 microversion: 2.1 time: 0.160938 Jun 21 05:55:56.194038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 157/308] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:56 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:56.696084 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:56.696771 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:56.703693 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:56.704134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:56.704893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:56.705322 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:56.835735 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:56.843365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c0cf4025-7905-435c-aee4-f610743fd775 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.151658 Jun 21 05:55:56.843933 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 152/309] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:56 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:57.210450 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:57.211259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:57.218659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:57.219381 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:57.220198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:57.220633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:57.398321 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:57.407344 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5854d9a4-758b-4f5b-bbae-e673f2f55414 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1502 microversion: 2.1 time: 0.200857 Jun 21 05:55:57.407926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 158/310] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:57 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:57.861161 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:57.861763 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:57.868372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:57.868756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:57.869547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:57.870014 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:58.009058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:58.020547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d2c8946e-fc7f-4d9e-8595-a521e01bda3d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.162855 Jun 21 05:55:58.021475 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 153/311] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:57 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:58.424389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:58.424987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:58.431665 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:58.432114 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:58.432862 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:58.433633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:58.568803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:58.576963 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f25b8303-a239-44cc-aa2d-dc6e778ba762 tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1502 microversion: 2.1 time: 0.156333 Jun 21 05:55:58.577563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 159/312] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:58 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:55:59.047626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:59.048406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:59.055675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:59.056121 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:59.056902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:59.057501 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:59.193346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:59.201472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-42e4f37a-d50c-4c74-85db-4d2922926db3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.158101 Jun 21 05:55:59.202060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 154/313] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:59 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:55:59.593864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:55:59.594547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:55:59.601216 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:59.601650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:59.602500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:55:59.602922 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:55:59.739236 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:55:59.747864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6e0c7879-d5cd-4ee3-81ae-30d46c0702ee tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1502 microversion: 2.1 time: 0.157708 Jun 21 05:55:59.748448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 160/314] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:55:59 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:00.218606 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:00.219205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:00.226081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:00.226520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:00.227309 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:00.227735 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:00.376030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:00.383952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1dd4cb59-4b1e-4a91-9154-7b9d1ca85b43 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.169130 Jun 21 05:56:00.384556 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 155/315] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:00 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:00.764834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:00.765449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:00.772601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:00.773032 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:00.773835 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:00.774303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:00.998195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:01.005658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-32ad78bf-1bdf-406b-917a-8f827803249f tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1502 microversion: 2.1 time: 0.244753 Jun 21 05:56:01.006333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 161/316] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:00 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:01.401265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:01.401903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:01.408376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:01.408818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:01.409587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:01.410045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:01.631253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:01.639756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c50df8d1-9237-4ce5-b6da-3cfc6fb94ca6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.242333 Jun 21 05:56:01.640418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 156/317] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:01 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:01.987005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-83214b6a-4365-48c7-9ad0-840a7163488c req-e69eba94-e96f-409a-a12d-c853b53b7d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24915532-1e10-4632-9b04-93b4c32ee970", "name": "network-vif-deleted", "tag": "fb2f74d9-9027-457c-9a77-fc0a5b21bbe0"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:01.996111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-83214b6a-4365-48c7-9ad0-840a7163488c req-e69eba94-e96f-409a-a12d-c853b53b7d46 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:01.996546 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-83214b6a-4365-48c7-9ad0-840a7163488c req-e69eba94-e96f-409a-a12d-c853b53b7d46 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:02.007777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-83214b6a-4365-48c7-9ad0-840a7163488c req-e69eba94-e96f-409a-a12d-c853b53b7d46 service nova] Creating event network-vif-deleted:fb2f74d9-9027-457c-9a77-fc0a5b21bbe0 for instance 24915532-1e10-4632-9b04-93b4c32ee970 on hv-cinder-84690 Jun 21 05:56:02.013053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-83214b6a-4365-48c7-9ad0-840a7163488c req-e69eba94-e96f-409a-a12d-c853b53b7d46 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029869 Jun 21 05:56:02.013644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 162/318] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:02.023783 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:02.024537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:02.030533 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:02.030967 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:02.031725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:02.032148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:02.100072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:02.111508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-427d41ef-c6fb-42c6-9596-adc4e35bb85a tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1460 microversion: 2.1 time: 0.091414 Jun 21 05:56:02.112572 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 157/319] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:02 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1460 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:02.658908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:02.659797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:02.668303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:02.668948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:02.670577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:02.671331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:02.821090 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:02.828791 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-eb5861c8-46e4-4eb3-bf01-054a004f1ffe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1522 microversion: 2.1 time: 0.175255 Jun 21 05:56:02.829353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 163/320] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:02 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:03.129222 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:03.130108 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:03.137089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:03.137815 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:03.139115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:03.139866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:03.174756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:03.175207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:03.175667 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lazy-loading 'fault' on Instance uuid 24915532-1e10-4632-9b04-93b4c32ee970 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:56:03.223625 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2decc2b4793f4b2297d6da0b32eb512e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbeaefc57cd14db6ba982fc059b70b70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:03.231690 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ac172b35-931c-4069-8ba2-323284176d3b tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 200 len: 1303 microversion: 2.1 time: 0.106757 Jun 21 05:56:03.232474 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 158/321] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:03 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:03.846213 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:03.846927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:03.854945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:03.855390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:03.856234 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:03.856856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:04.044324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:04.061680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-79ec5600-1e4d-4106-9684-37e7d5d495ea tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1502 microversion: 2.1 time: 0.219768 Jun 21 05:56:04.062366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:03 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:04.079697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:04.080614 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:04.087553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:04.088592 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:04.089371 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:04.089827 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:04.235193 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:04.243001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-99cc8f59-7375-40c6-b23d-370952ddefb1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1515 microversion: 2.1 time: 0.168465 Jun 21 05:56:04.243954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 159/323] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:04 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:04.249445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:04.249999 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] [instance: 24915532-1e10-4632-9b04-93b4c32ee970] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:04.257841 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:04.258341 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:04.259123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:04.259548 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:04.273621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] HTTP exception thrown: Instance 24915532-1e10-4632-9b04-93b4c32ee970 could not be found. Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Request method failure captured: Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 HTTP/1.1 Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV03frRctL5UQWczJq4Hh6xG5nyc1qWRU6neY6W0jJwnZ_9aafEQYFMflZRyQ818JVC2Vj1Bdqmhwex9xuSYAmXPhSHBpfTNgc4aAXhPp9vDcjXGyfNKjCLRSGuT1p3CwqBLf6BQzVEGFmiBdR3ciKuK_i6XHsYuABGd5FfxrhR_qyY Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: cbeaefc57cd14db6ba982fc059b70b70 Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesActionsTest-1937324591 Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:56:04.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/cbeaefc57cd14db6ba982fc059b70b70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesActionsTest-1937324591 Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: cbeaefc57cd14db6ba982fc059b70b70 Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesActionsTest-1937324591 Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesActionsTest-1937324591-project Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 2decc2b4793f4b2297d6da0b32eb512e Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesActionsTest-1937324591-project Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 24915532-1e10-4632-9b04-93b4c32ee970 could not be found. Jun 21 05:56:04.276856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '24915532-1e10-4632-9b04-93b4c32ee970'} Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24915532-1e10-4632-9b04-93b4c32ee970 could not be found. Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:56:04.277616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24915532-1e10-4632-9b04-93b4c32ee970 could not be found. Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24915532-1e10-4632-9b04-93b4c32ee970 could not be found. Jun 21 05:56:04.278832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:04.279826 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] Returning 404 to user: Instance 24915532-1e10-4632-9b04-93b4c32ee970 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:56:04.279826 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-da544e45-6cba-4960-ae96-371fcafe29ed tempest-VolumesActionsTest-1937324591 tempest-VolumesActionsTest-1937324591-project] 10.222.0.18 "GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970" status: 404 len: 111 microversion: 2.1 time: 0.031300 Jun 21 05:56:04.279826 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 165/324] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:04 2022] GET /compute/v2.1/servers/24915532-1e10-4632-9b04-93b4c32ee970 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 05:56:05.670689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:05.671638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:05.677968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:05.678351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:05.679144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:05.679573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:05.704047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'flavor' on Instance uuid 68510b32-92ff-4e8b-9c40-00a56f652c61 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:56:05.741436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:05.784192 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-477ab7b7-55ff-4cd1-beb4-b2efd44003b6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/action" status: 200 len: 32 microversion: 2.1 time: 0.118461 Jun 21 05:56:05.784790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 160/325] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:56:05 2022] POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/action => generated 32 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 05:56:05.794407 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:05.795019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:05.801369 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:05.801825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:05.802634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:05.803062 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:06.044590 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:06.053363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a44ff164-4e0a-4d40-b0cf-d37952869dfe tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.263144 Jun 21 05:56:06.054100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 166/326] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:05 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:07.070813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:07.071507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:07.077808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:07.078290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:07.079061 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:07.079496 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:07.231329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:07.240397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f2cdfbb5-4fb0-4d94-b8cb-ec7e68793f38 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.173789 Jun 21 05:56:07.241133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 161/327] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:07 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:08.258778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:08.259387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:08.265702 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:08.266180 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:08.266944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:08.267376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:08.402099 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:08.409851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f6a2dd3d-90db-4cfd-9335-704b9602c6f7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.154881 Jun 21 05:56:08.410473 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 167/328] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:08 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:09.426830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:09.427437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:09.433519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:09.433999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:09.434768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:09.435207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:09.582790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:09.592153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-299613ae-a0be-4c06-a96f-451a9c211917 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.169124 Jun 21 05:56:09.592729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 162/329] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:09 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:10.610526 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:10.611113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:10.618282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:10.618721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:10.619667 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:10.620098 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:10.772444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:10.782277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-695d1d69-f7c3-4ef1-8b96-1f168db71460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.175508 Jun 21 05:56:10.782884 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:10 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:11.801408 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:11.802628 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:11.810001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:11.810512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:11.811284 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:11.811715 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:11.957214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:11.965196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-11851602-3bbf-4bda-bb14-6c176c8ef460 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.169463 Jun 21 05:56:11.965782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 163/331] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:11 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:12.982647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:12.983182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:12.991802 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:12.992245 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:12.993020 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:12.993448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:13.135551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:13.148586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6ca8e2cc-7116-4ad9-b90f-c5fef839679d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.169779 Jun 21 05:56:13.149174 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 169/332] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:12 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:14.167540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:14.168458 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:14.174595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:14.175039 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:14.175838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:14.176272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:14.326177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:14.328075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-116185a7-f87b-425a-ba66-4b5f3e96583b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.165165 Jun 21 05:56:14.328661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 164/333] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:14 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:14.939809 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:14.940509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:14.947271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:14.947711 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:14.948508 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:14.948937 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:14.974883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cdba25ce-6d36-42c5-a27a-55fa0266a6c5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/ips" status: 200 len: 146 microversion: 2.1 time: 0.038834 Jun 21 05:56:14.975458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 170/334] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 05:56:14 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:15.345803 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:15.346451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:15.352975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:15.354166 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:15.354811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:15.355247 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:15.514334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:15.524159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7799d8aa-468b-4fdd-be5e-716028dbd9e5 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.182091 Jun 21 05:56:15.524834 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 165/335] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:15 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:16.542524 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:16.543129 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:16.549244 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:16.549688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:16.550475 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:16.551011 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:16.555236 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:16.692619 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:16.700302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1183aec0-baba-4829-b71f-9280622d98bf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.163024 Jun 21 05:56:16.700965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 171/336] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:16 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:17.716731 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:17.717337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:17.723819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:17.724264 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:17.725031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:17.725464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:17.860761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:17.870136 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a6ca5759-a5fb-458c-83f1-f786e901904e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.157063 Jun 21 05:56:17.870716 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 166/337] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:17 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:18.812535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:18.813078 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:18.815332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=46 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:18.821336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:18.821881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:18.822783 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:18.823284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:18.848215 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a3030d19-b3e2-46e0-9a56-2a797e51fe04 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/ips" status: 200 len: 149 microversion: 2.1 time: 0.039577 Jun 21 05:56:18.848774 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 172/338] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 05:56:18 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:18.887012 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:18.887615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:18.893817 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:18.894298 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:18.895071 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:18.895494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:19.039949 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:19.059807 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ef7b1666-4a90-488d-ae28-b3a684b032c4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.176582 Jun 21 05:56:19.060757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 167/339] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:18 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:19.271347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76b225e1-bcfb-430a-a506-4dd5e2895297"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:19.272803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:19.279592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:19.280283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:19.281264 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:19.282006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:19.363251 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1561309903", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:19.588822 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-496c6516-2050-4fe3-941e-aaae29372742 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322170 Jun 21 05:56:19.594818 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 173/340] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:56:19 2022] POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:19.841647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:19.842363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:19.852650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:19.853674 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:19.854500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:19.854932 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:19.863046 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] validate_networks() for None {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:56:19.886272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6a425437-50b0-4145-99bc-47795b8ae302 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/ips" status: 200 len: 151 microversion: 2.20 time: 0.050271 Jun 21 05:56:19.886907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 174/341] 10.222.0.18 () {60 vars in 1288 bytes} [Tue Jun 21 05:56:19 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 21 05:56:20.079265 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:20.080487 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:20.091591 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:20.093307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:20.094674 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:20.095180 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:20.431594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:56:20.432645 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:56:20.433279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:56:20.434756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:56:20.435562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:56:20.459492 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:20.459895 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:20.461440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:20.463520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:20.469707 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:20.488168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c9620654-4e48-4a77-ab17-4c49c39d9e68 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.413370 Jun 21 05:56:20.505268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 175/342] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:20 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:56:20.514477 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "371419f4-5ca9-4046-9c7d-f87c77e1d368"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:20.517431 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:20.529699 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Getting quotas for project 88247de6a0dc4a1089749816533eabd2. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:56:20.537598 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Getting quotas for user 81262a5bbc824136ba8d940442dfae66 and project 88247de6a0dc4a1089749816533eabd2. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:56:20.544326 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:20.545033 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:20.548343 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:20.551246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:20.557568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:56:20.560772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:56:20.630775 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a69b8973-4ee6-4af4-a30d-4670ed668414 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.272462 Jun 21 05:56:20.632031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 168/343] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:56:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1274 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 05:56:20.643123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2dd7a8aa-e1b4-4624-8cde-1c0eabe144d2 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:20.644274 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2dd7a8aa-e1b4-4624-8cde-1c0eabe144d2 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:20.716822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2dd7a8aa-e1b4-4624-8cde-1c0eabe144d2 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:20.730694 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2dd7a8aa-e1b4-4624-8cde-1c0eabe144d2 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1215 microversion: 2.1 time: 0.092192 Jun 21 05:56:20.731953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 169/344] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:20 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:20.978873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-54b84002-9728-4d6b-bebf-7fd0bcf31539 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.470923 Jun 21 05:56:20.980186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 176/345] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:56:20 2022] POST /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:21.512359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:21.513021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:21.520745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:21.521272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:21.522118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:21.522799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:21.671893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:21.679694 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-62649422-a44f-489d-81df-86a1255b8d5d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.171775 Jun 21 05:56:21.680266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 170/346] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:21 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:21.756374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:21.758219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:21.766725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:21.767725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:21.769366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:21.770697 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:21.861193 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:21.871100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ecec7a7a-9697-47b4-9622-869263b53c7c tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1267 microversion: 2.1 time: 0.124131 Jun 21 05:56:21.882544 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 177/347] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:21 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:22.705902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:22.712718 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:22.735972 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:22.737644 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:22.738206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:22.738948 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:22.739407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:22.766133 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:22.766937 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:22.778883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:22.779337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:22.780155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:22.780595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:22.836576 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lazy-loading 'flavor' on Instance uuid ec84758b-79f0-4883-8081-9b2b09d7b812 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:56:23.404899 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-39c17675-40a1-46e4-a7d6-697fb01c4b99 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/action" status: 202 len: 0 microversion: 2.20 time: 0.643600 Jun 21 05:56:23.411024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 178/348] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 21 05:56:22 2022] POST /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/action => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:56:23.434007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:23.436212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:23.453636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:23.463160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:23.463601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:23.464424 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:23.464861 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:23.471385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-56e879a9-dc6d-464e-836e-8d99c68e8857 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.777082 Jun 21 05:56:23.472583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 171/349] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:22 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:23.480453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:23.480983 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:23.500372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:23.501479 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:23.502937 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:23.503687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:23.755163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:23.775231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-899b4d74-4260-4359-9770-7cf0331221c1 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1273 microversion: 2.1 time: 0.348832 Jun 21 05:56:23.780870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 179/350] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:23 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:23.883794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:23.894794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:23.896562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:23.897974 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d7342a31-1275-421c-9716-ec3e5262874a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.424248 Jun 21 05:56:23.909008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 172/351] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:23 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:24.490013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:24.491379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:24.499917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:24.500451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:24.502093 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:24.502797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:24.784889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:24.793245 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:24.796033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:24.807472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7ec1f069-3dd7-4ff0-aa2a-f20464adbc4b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.313082 Jun 21 05:56:24.807472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 180/352] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:24 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:24.815566 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:24.816303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:24.817095 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:24.817527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:24.917395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:24.918268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:24.925852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:24.926137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:24.927008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:24.927455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:25.266372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:25.286949 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0bfdfce5-e7af-42cc-bd63-5e9fdf4dd15d tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.497626 Jun 21 05:56:25.293719 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 173/353] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:24 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:25.393440 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:25.406480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:25.409521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:25.411417 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b34036d5-4478-41e6-8f30-b8ca78eaae8c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.498625 Jun 21 05:56:25.412903 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 181/354] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:24 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:56:25.673595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-f9dc39a7-d6e8-4613-a821-f9f3e85c7d4e req-62b8e6de-e9c7-454e-999b-d43c6e282049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63ea319-e39c-4ed2-abd2-8a7d0e6067e9", "tag": "8c88900f-f763-4965-a618-dd4e347841d0"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:25.701491 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f9dc39a7-d6e8-4613-a821-f9f3e85c7d4e req-62b8e6de-e9c7-454e-999b-d43c6e282049 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:25.703231 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f9dc39a7-d6e8-4613-a821-f9f3e85c7d4e req-62b8e6de-e9c7-454e-999b-d43c6e282049 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:25.719985 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-f9dc39a7-d6e8-4613-a821-f9f3e85c7d4e req-62b8e6de-e9c7-454e-999b-d43c6e282049 service nova] Creating event network-changed:8c88900f-f763-4965-a618-dd4e347841d0 for instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 on hv-cinder-84690 Jun 21 05:56:25.726630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-f9dc39a7-d6e8-4613-a821-f9f3e85c7d4e req-62b8e6de-e9c7-454e-999b-d43c6e282049 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058130 Jun 21 05:56:25.728505 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 174/355] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:25.814201 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:25.815082 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:25.823119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:25.824263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:25.825437 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:25.826218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:26.313925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:26.315193 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:26.316747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:26.327662 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:26.328134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:26.331341 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:26.331341 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:26.331567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e55b41cf-16c3-4b41-9b59-ff1cf684f6a0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.519429 Jun 21 05:56:26.334306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 182/356] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:25 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:26.432684 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:26.433613 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:26.441287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:26.451258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:26.453821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:26.455639 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:27.432304 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:27.436398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:27.449179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:27.457505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:27.459074 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c4e8523a-2970-4f75-8d8f-b205b7bce72e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 1.030418 Jun 21 05:56:27.465780 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 183/357] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:26 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:56:27.472195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:27.487762 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:27.488569 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-165b117b-74e7-46ce-a885-454b1b4deb9f tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 1.181073 Jun 21 05:56:27.488715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:27.492355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 175/358] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:26 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:27.517067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:27.518667 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:27.523400 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:27.523916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:27.676558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7ac3fd1d-cd7b-4979-acb5-fdd5bafd58f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:27.691789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7ac3fd1d-cd7b-4979-acb5-fdd5bafd58f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:27.694934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7ac3fd1d-cd7b-4979-acb5-fdd5bafd58f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:27.850809 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7ac3fd1d-cd7b-4979-acb5-fdd5bafd58f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Going to try to stop instance {{(pid=117430) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 05:56:27.912383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:27.923483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f476d753-be8d-40e1-b0b8-58f1aab32613 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.456323 Jun 21 05:56:27.924077 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 184/359] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:27 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:27.971533 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7ac3fd1d-cd7b-4979-acb5-fdd5bafd58f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.302025 Jun 21 05:56:27.974824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 176/360] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:56:27 2022] POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 05:56:27.985601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:27.987027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:28.001208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.002932 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.004402 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.005689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.300551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:28.311912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-177af822-553e-4f64-8987-4718803fecb9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.331310 Jun 21 05:56:28.312595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 185/361] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:27 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:28.489053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:28.491207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:28.521183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:28.522059 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:28.526657 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.528679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.531529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.532156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.545278 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.546382 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.548970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.550142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.836571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:28.848312 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:28.853353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8b789078-13c8-427e-9bec-49c117fdb0a9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.346749 Jun 21 05:56:28.854394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 186/362] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:28 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:28.867619 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:28.876571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:28.884835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:28.886813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9b2cc0af-9dca-49fb-ae59-54615d337f36 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.405100 Jun 21 05:56:28.889456 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 177/363] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:28 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:28.943339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:28.944124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:28.956154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.957756 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:28.959360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:28.960415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:29.245554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:29.256253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d6c2dbe8-8fbf-4158-9b2c-c6462fb8eed4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.318219 Jun 21 05:56:29.267297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 187/364] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:28 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:29.332923 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:29.333576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:29.341871 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:29.342366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:29.343259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:29.345585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:29.515362 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:29.528461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1f848dbf-ab91-4001-8f9e-6d761a725763 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.199848 Jun 21 05:56:29.530377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 178/365] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:29 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:29.872671 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:29.873364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:29.889556 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:29.890101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:29.891135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:29.891484 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:29.920458 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:29.923667 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:29.940242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:29.940702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:29.941814 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:29.946623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:30.279429 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:30.306179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-eecfe023-8e97-450a-b6b9-20cbc101e624 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.437689 Jun 21 05:56:30.308824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 188/366] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:29 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:30.319089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:30.339937 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:30.341004 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:30.346354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:30.349391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:30.350099 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:30.351007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:30.351606 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:30.363266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:30.370477 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9e5a96f1-e4e4-403b-9364-08fd91ab78a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.453340 Jun 21 05:56:30.372337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 179/367] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:29 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:30.547677 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:30.548597 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:30.550584 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:30.564912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:30.566236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:30.568793 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:30.569506 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:30.653116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:30.683032 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5fc2caa0-5b6d-401f-a5c1-73e3b5141d6e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.371547 Jun 21 05:56:30.686905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 189/368] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:30 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:30.722570 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=8 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:30.807394 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:30.816783 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-317f3985-63ca-4b68-9415-9b433815cf78 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.274374 Jun 21 05:56:30.817537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 180/369] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:30 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:56:31.344873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:31.349035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:31.371569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.374433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.375374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.375815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.402357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:31.403372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:31.417830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.418291 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.420201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.420811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.693021 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:31.702191 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:31.712502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1dedd7be-16b1-409c-a171-6d9e18c696c0 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.380884 Jun 21 05:56:31.713022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:31.714564 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:31.717870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a9d4cf0c-e2c3-4151-9e51-a3da3386f166 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.322624 Jun 21 05:56:31.723286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 190/370] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:31 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:31.728374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:31.729183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:31.732590 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 181/371] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:31 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:56:31.736879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.737328 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.738166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.738610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.862387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:31.864029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:31.893487 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.895872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.897502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:31.898547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:31.965111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:31.978517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b6558e38-1a78-43f2-8cdf-8eabbc778249 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.253786 Jun 21 05:56:31.982353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 191/372] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:31 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:32.346359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:32.361889 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-75326daa-d609-4644-9e6d-1519c52748c8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.529801 Jun 21 05:56:32.365189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 182/373] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:31 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:32.730661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:32.731877 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:32.739381 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:32.740392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:32.745967 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:32.749373 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:32.750105 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:32.751092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:32.751833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:32.752290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:32.753091 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:32.753528 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:33.468005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:33.481526 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:33.486754 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a67cac6b-3441-489c-89fe-aea2b57d6a12 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.760700 Jun 21 05:56:33.497771 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 192/374] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:32 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:33.501207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:33.503169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:33.503434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:33.504100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:33.504979 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-059bc912-4f3d-409f-9dcb-8231b5d7f9b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.771339 Jun 21 05:56:33.505707 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 183/375] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:32 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:33.512081 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:33.512766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:33.513711 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:33.514322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:33.518332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:33.519056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:33.531655 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:33.532297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:33.533225 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:33.533807 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:33.892786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:33.900089 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:33.905676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-359286c3-179a-4db6-ab51-787d39fac632 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.398018 Jun 21 05:56:33.906582 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 184/376] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:33 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:33.924531 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5687fa93-3d55-47ae-92b3-81dbc07cc6da tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1501 microversion: 2.1 time: 0.425297 Jun 21 05:56:33.925570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 193/377] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:33 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1501 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:33.947809 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b150b2ae-a26f-4ed6-bf0e-ff3bb73ba6ba"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:33.955201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:33.971889 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:33.972496 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:33.973292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:33.974047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.071609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] HTTP exception thrown: Cannot 'attach_volume' instance 68510b32-92ff-4e8b-9c40-00a56f652c61 while it is in vm_state rescued Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Request method failure captured: Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/os-volume_attachments HTTP/1.1 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 74 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisVz_Z9TyzhytPasjjVgIW6mOwReV5vngrpMrqo-qW94z2uf63XGuiYeGQbP-gYx6kKffTX8IYYkxgpoWBTCyOGl1niXnbR9nZ0MIzx0r6sAqiLDnvjw4ILhCVFJZimgnZ-_iUJqShtj8viDr3XekjhhIYaBW2Tfjd4klvxi5FulnWX8 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:56:34.075133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f2d23615fd6349e1b70fdbad64b89b78 Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {"volumeAttachment": {"volumeId": "b150b2ae-a26f-4ed6-bf0e-ff3bb73ba6ba"}} Jun 21 05:56:34.076532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Cannot 'attach_volume' instance 68510b32-92ff-4e8b-9c40-00a56f652c61 while it is in vm_state rescued Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'server_id': '68510b32-92ff-4e8b-9c40-00a56f652c61', 'body': {'volumeAttachment': {'volumeId': 'b150b2ae-a26f-4ed6-bf0e-ff3bb73ba6ba'}}} Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:56:34.077326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 68510b32-92ff-4e8b-9c40-00a56f652c61 while it is in vm_state rescued Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:56:34.078483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:56:34.079593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:56:34.079593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:56:34.079593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 68510b32-92ff-4e8b-9c40-00a56f652c61 while it is in vm_state rescued Jun 21 05:56:34.079593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:56:34.081636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Returning 409 to user: Cannot 'attach_volume' instance 68510b32-92ff-4e8b-9c40-00a56f652c61 while it is in vm_state rescued {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:56:34.082759 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ec231500-dbd6-4c92-8857-834bca8e1581 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.143765 Jun 21 05:56:34.083520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 185/378] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:56:33 2022] POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/os-volume_attachments => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 05:56:34.094670 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:34.095421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:34.106547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.107000 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.107779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.108233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.193612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-31eab5f2-0e08-4ca8-9e17-6b2a714c8c58 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/action" status: 202 len: 0 microversion: 2.1 time: 0.104016 Jun 21 05:56:34.194651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 194/379] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:56:34 2022] POST /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 05:56:34.204808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:34.205624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:34.215371 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.217462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.219604 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.220244 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.504960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:34.505815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:34.521082 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.525995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.527275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.528297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.815242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:34.824147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-263f356a-d864-4b59-ad5a-27d4a71104b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1509 microversion: 2.1 time: 0.623569 Jun 21 05:56:34.826357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 186/380] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:34 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1509 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:34.842385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:34.846512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:34.859522 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.867362 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:34.869149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:34.870288 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:35.151132 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:35.172287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1ae649ba-3c63-4e00-be96-02f1bc7c4f71 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.671742 Jun 21 05:56:35.172884 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 195/381] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:34 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:35.191218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-e94a5df5-d388-44ec-bc07-6524687db517 req-570e19bd-79cd-4961-9d77-0e1ed47893ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63ea319-e39c-4ed2-abd2-8a7d0e6067e9", "name": "network-vif-plugged", "status": "completed", "tag": "8c88900f-f763-4965-a618-dd4e347841d0"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:35.209103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-e94a5df5-d388-44ec-bc07-6524687db517 req-570e19bd-79cd-4961-9d77-0e1ed47893ef service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:35.209827 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-e94a5df5-d388-44ec-bc07-6524687db517 req-570e19bd-79cd-4961-9d77-0e1ed47893ef service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:35.245979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-e94a5df5-d388-44ec-bc07-6524687db517 req-570e19bd-79cd-4961-9d77-0e1ed47893ef service nova] Creating event network-vif-plugged:8c88900f-f763-4965-a618-dd4e347841d0 for instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 on hv-cinder-84690 Jun 21 05:56:35.252398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-e94a5df5-d388-44ec-bc07-6524687db517 req-570e19bd-79cd-4961-9d77-0e1ed47893ef service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078097 Jun 21 05:56:35.253263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 196/382] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:35.265295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:35.266180 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:35.277985 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:35.291425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:35.292114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:35.294656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-30f22a51-1df3-4f35-913f-b34739b13eb5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.465557 Jun 21 05:56:35.306669 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 187/383] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:34 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:35.317892 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:35.319326 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:35.320934 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:35.321391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:35.720582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:35.733167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-63a9ce56-25a1-4ecd-ae98-5f165fa7415a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.478413 Jun 21 05:56:35.733745 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 197/384] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:35 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:35.754547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cbce6697-8ffb-436e-894c-90625e5ccf94 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: .version_select at 0x7efe5c8ba940>, body: {"keypair": {"name": "tempest-keypair-151672078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELFbHoZLMuGldobQHqvUVGptnz4CLL4ZF4I4gq8yuFlFqwaWeC9PVJfn0r+ba0w61jDlEGt7Ds6DwWZ2Zb//QApjYFVXzjzHt9XbFkR7rRaH/c1Mzm6CTAd0D2sdNG1ng=="}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:35.794156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-cbce6697-8ffb-436e-894c-90625e5ccf94 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:56:35.803329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-cbce6697-8ffb-436e-894c-90625e5ccf94 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:56:35.843024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:35.843649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:35.861257 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:35.862187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:35.863279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:35.863973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:35.874099 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cbce6697-8ffb-436e-894c-90625e5ccf94 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131608 Jun 21 05:56:35.875451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 188/385] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:56:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:36.197695 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:36.198352 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:36.208188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:36.210282 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:36.211893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:36.214591 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:36.516502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:36.528668 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-802d4edf-a17d-4b76-a076-0e8b870e2a67 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1509 microversion: 2.1 time: 0.689532 Jun 21 05:56:36.538681 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 198/386] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:35 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1509 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:36.543804 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:36.544421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:36.582463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:36.583884 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:36.584529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:36.585320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:36.587315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:36.591436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-07b6d79b-d61d-421a-8657-23e14fb12915 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.398545 Jun 21 05:56:36.601627 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 189/387] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:36 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:36.766630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:36.767660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:36.782341 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:36.789020 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:36.790685 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:36.796144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:36.952031 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:36.968633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:36.973023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:36.975261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-add37a25-44b7-48c8-8925-45a1d18cefae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.435194 Jun 21 05:56:36.978096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 199/388] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:36 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:37.072885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:37.094344 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-02617b8f-9483-4d62-a6f2-81793accf057 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.332562 Jun 21 05:56:37.095881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 190/389] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:36 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:56:37.556572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:37.562303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:37.598637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:37.599118 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:37.599951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:37.600399 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:37.605663 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:37.626445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:37.632559 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:37.671702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:37.676521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:37.678058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:37.678793 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:38.000530 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:38.021644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:38.032643 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1d499b13-2aed-456f-a419-8d8264b241e7 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1315 microversion: 2.1 time: 0.413858 Jun 21 05:56:38.042639 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 191/390] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:37 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:38.044231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-70d10b29-7c97-4714-bf53-a25e113cb79b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1509 microversion: 2.1 time: 0.497948 Jun 21 05:56:38.045870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 200/391] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:37 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:38.048200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:38.048812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:38.065768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:38.066235 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:38.067253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:38.067850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:38.135706 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:38.139557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:38.161745 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:38.166695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:38.169094 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:38.169704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:38.634645 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:38.643615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-08de494f-daea-4af9-970c-35c974168dd2 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.526095 Jun 21 05:56:38.649013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 201/392] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:38 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:38.677851 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:38.690355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:38.694791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:38.698295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2227eb4b-f7f7-4938-9989-bb30f5ce0e9f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.654323 Jun 21 05:56:38.700439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 192/393] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:38 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:39.080864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:39.083589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:39.113993 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:39.116248 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:39.118705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:39.119568 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:39.126894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:39.128038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:39.147890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:39.149382 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:39.152657 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:39.158323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:39.699600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:39.714922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-84629b3f-ed33-46d1-833f-9be5f750afc1 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1515 microversion: 2.1 time: 0.591843 Jun 21 05:56:39.716930 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 193/394] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:39 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1515 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:39.729012 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-319728532", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "networks": [{"uuid": "e61240a9-48fb-49f1-8f20-d7bad2434914"}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:39.741598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:39.754202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-87a5e5c9-8d5c-4482-acd5-1d4e6261f92b tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1465 microversion: 2.1 time: 0.706093 Jun 21 05:56:39.766829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 202/395] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:39 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1465 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:39.787958 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:39.800243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:39.819579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:39.824614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:39.830653 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:39.832933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:39.996804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] validate_networks() for [('e61240a9-48fb-49f1-8f20-d7bad2434914', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:56:40.485740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:40.502873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6335ecfd-7b80-424a-a3fd-c229f599802b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.734966 Jun 21 05:56:40.503818 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 203/396] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:39 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:40.518176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:40.518881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:40.525972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:40.526431 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:40.527236 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:40.527656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:40.845263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:40.861601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:40.863849 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:40.865069 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bb175e95-ddf5-4270-927d-b31065e25071 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.360312 Jun 21 05:56:40.866420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 204/397] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:40 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:40.877557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:40.878514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:40.897454 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:56:40.898278 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:56:40.898546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:56:40.899049 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:56:40.900202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:56:40.905091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:40.905549 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:40.906367 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:40.906802 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:40.920022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:40.921182 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:40.923754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:40.924822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:40.960471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:56:40.963120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Getting quotas for project a7e723a47d5246779d7835b9898429e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:56:40.971884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Getting quotas for user fc4e3249c43c4e8292475684ce7fd36e and project a7e723a47d5246779d7835b9898429e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:56:40.993450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:56:40.998140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:56:41.091798 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a30db659-e8cc-4b25-b949-4d26eaa69fbe tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371841 Jun 21 05:56:41.094156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 194/398] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:56:41.138985 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-656985797", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af2e04db-de33-4272-99f0-75327f84c194"}], "security_groups": [{"name": "tempest-securitygroup--554221573"}], "key_name": "tempest-keypair-151672078", "user_data": "}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:41.170790 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-648df330-2f21-48ee-84d2-70db8bdad656 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 204 len: 0 microversion: 2.1 time: 0.299346 Jun 21 05:56:41.183630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 205/399] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:56:40 2022] DELETE /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:56:41.216659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cc4f27a8-0a23-4258-9397-68b45438bdb9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:41.217611 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cc4f27a8-0a23-4258-9397-68b45438bdb9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:41.309983 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cc4f27a8-0a23-4258-9397-68b45438bdb9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:41.321445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cc4f27a8-0a23-4258-9397-68b45438bdb9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1218 microversion: 2.1 time: 0.128620 Jun 21 05:56:41.322248 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 206/400] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:41 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:41.330608 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] validate_networks() for [('af2e04db-de33-4272-99f0-75327f84c194', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:56:41.337487 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:41.338289 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:41.346733 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:41.347427 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:41.348334 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:41.348876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:41.731259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:41.740587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-034aa1b5-98da-44b4-8a21-6b75bde1ffbe tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1471 microversion: 2.1 time: 0.407516 Jun 21 05:56:41.745155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 207/401] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:41 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1471 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:41.755510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:41.756500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:41.788513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:41.789384 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:41.791281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:41.792158 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.459679 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:42.473782 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8870b07b-3714-44ae-9c37-d7feb7977597 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 0.726990 Jun 21 05:56:42.490293 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 208/402] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:41 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:42.499623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3d4ff2c9-e88d-4996-aefc-298aeda042de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'create', calling method: .version_select at 0x7efe5c86d280>, body: {"keypair": {"name": "tempest-keypair-141764244", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj8yy7YGDsu26mpd5PHsJUeYx7+vTNCsGG9YhU/Q1emUK4HY21mcIVt3rAMUTHcoQ8NwIYL0lLrr7hrk0YlZyPqH4XGpDBvEZ56NeCjnFon7d+S1EcbfDP6H3ib1GBv0Q=="}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:42.505697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:56:42.506639 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:56:42.507570 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:56:42.509001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:56:42.510093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:56:42.527708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.528938 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.529748 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-3d4ff2c9-e88d-4996-aefc-298aeda042de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:56:42.531476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.532620 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.535316 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-3d4ff2c9-e88d-4996-aefc-298aeda042de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for user f2d23615fd6349e1b70fdbad64b89b78 and project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:56:42.570802 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3d4ff2c9-e88d-4996-aefc-298aeda042de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.078421 Jun 21 05:56:42.574263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 209/403] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:56:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:42.582327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:42.585845 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:42.593063 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.593871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.594879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.595460 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.596717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:56:42.623673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:56:42.672045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:56:42.686165 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:56:42.794267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:42.805403 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:42.807600 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:42.809158 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9489cf4a-c7e3-4b24-93d4-17bacad983bd tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.233588 Jun 21 05:56:42.809985 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 210/404] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:42 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:42.815556 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:42.816464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:42.824161 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.825270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.826661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.827848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.900129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7283b708-1dbd-4932-a9f5-3147cef2a1fe tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.773094 Jun 21 05:56:42.911087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 195/405] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:56:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:56:42.926838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:42.938076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f2743ff3-6174-43a0-84e9-b33e4e97f403 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1222 microversion: 2.1 time: 0.126560 Jun 21 05:56:42.938977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 211/406] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:42 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1222 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:42.956865 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-915e27bf-9c5c-4d4a-9a02-3f9d22ed6264 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:42.958302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-915e27bf-9c5c-4d4a-9a02-3f9d22ed6264 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:42.960720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:42.969792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:42.973310 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:42.995608 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:42.996420 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:42.997874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:43.003722 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:43.357108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-915e27bf-9c5c-4d4a-9a02-3f9d22ed6264 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:43.385381 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-915e27bf-9c5c-4d4a-9a02-3f9d22ed6264 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1240 microversion: 2.1 time: 0.442505 Jun 21 05:56:43.387001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 212/407] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:42 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1240 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:43.516035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:43.527396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:43.575749 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:43.576603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:43.577763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:43.590154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:43.923185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:43.968399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1fa5c43b-5f27-4a14-897b-b5165219de14 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1471 microversion: 2.1 time: 1.043043 Jun 21 05:56:43.998391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 196/408] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:42 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1471 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:44.009463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:44.011316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:44.025705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:44.026901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:44.029527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:44.030633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:44.082267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:44.490721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:44.512761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:44.519337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:44.521586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d655a42f-23a7-4ac9-857b-a68ee5a18e25 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.521233 Jun 21 05:56:44.550997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 197/409] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:43 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:44.557643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:44.568210 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:44.571805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:44.574397 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6f1225ac-61bf-4042-bd01-c3315754e82b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1724 microversion: 2.1 time: 1.078697 Jun 21 05:56:44.581395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 213/410] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:43 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1724 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:44.589527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:44.591180 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:44.592291 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:44.602818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:44.605777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:44.606662 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:44.627017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:44.628333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:44.629710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:44.630410 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:44.806856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:44.830723 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-adfcbc1c-70fe-41c0-bdaa-f7e9b5f339a4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1244 microversion: 2.1 time: 0.244360 Jun 21 05:56:44.831492 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 214/411] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:44 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1244 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:44.881325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:44.934792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-62c6c37c-5180-4b95-a648-408176b7d3bf tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1276 microversion: 2.1 time: 0.389941 Jun 21 05:56:44.939725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 198/412] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:44 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1276 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:45.006938 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:45.022966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:45.054919 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.059272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:45.062619 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.065618 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:45.411957 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:45.449769 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-94683d1d-eb61-4e47-8840-3a3f8553f247 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1429 microversion: 2.1 time: 0.454264 Jun 21 05:56:45.475843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 215/413] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:44 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1429 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:45.491757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-4328db94-678c-49ce-aef5-bd211ed84e20 req-13dfbd7a-029d-44ed-8fec-f3e07960b17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63ea319-e39c-4ed2-abd2-8a7d0e6067e9", "name": "network-vif-deleted", "tag": "8c88900f-f763-4965-a618-dd4e347841d0"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:45.548680 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-4328db94-678c-49ce-aef5-bd211ed84e20 req-13dfbd7a-029d-44ed-8fec-f3e07960b17b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.549735 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-4328db94-678c-49ce-aef5-bd211ed84e20 req-13dfbd7a-029d-44ed-8fec-f3e07960b17b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:45.567465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:45.569124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:45.580824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.581571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:45.582634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.603291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:45.643760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-4328db94-678c-49ce-aef5-bd211ed84e20 req-13dfbd7a-029d-44ed-8fec-f3e07960b17b service nova] Creating event network-vif-deleted:8c88900f-f763-4965-a618-dd4e347841d0 for instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 on hv-cinder-84690 Jun 21 05:56:45.678554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-4328db94-678c-49ce-aef5-bd211ed84e20 req-13dfbd7a-029d-44ed-8fec-f3e07960b17b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187385 Jun 21 05:56:45.682916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 199/414] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:45.770401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:45.773185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:45.788323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.793262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:45.800388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:45.801687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.109850 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.141562 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.145061 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.148914 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.151165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f778128f-0f73-4305-8d92-e050196074ae tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1744 microversion: 2.20 time: 0.596334 Jun 21 05:56:46.152634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 216/415] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:45 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1744 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:46.161770 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:46.162603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-74dc33bc-49f2-4ba9-aa8e-cb9d34ebf4bd tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1701 microversion: 2.1 time: 0.460631 Jun 21 05:56:46.163033 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:46.163674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 200/416] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:45 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1701 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:46.182491 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:46.183312 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:46.188585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:46.197998 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.198772 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.200168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.201045 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.220197 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.220673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.225009 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.225492 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.461160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.481840 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.491643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-53f65941-6ac7-4d8e-ab70-e97bf8b8885b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1298 microversion: 2.1 time: 0.336936 Jun 21 05:56:46.494221 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 217/417] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:46 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1298 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:46.501385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a7ad7869-86c5-4b23-91b3-4248217a43d4 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1276 microversion: 2.1 time: 0.335027 Jun 21 05:56:46.505984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 201/418] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:46 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1276 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:46.512271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-df7dc6f3-8166-4f3a-ae51-7b6671dc6c4d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:46.525088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:46.529435 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:46.538110 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-df7dc6f3-8166-4f3a-ae51-7b6671dc6c4d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.543459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-df7dc6f3-8166-4f3a-ae51-7b6671dc6c4d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.559079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.560439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.564082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.566583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.630852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:46.733466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-df7dc6f3-8166-4f3a-ae51-7b6671dc6c4d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Going to try to start instance {{(pid=117431) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 05:56:46.743634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.745062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.746184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lazy-loading 'fault' on Instance uuid a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:56:46.843154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-df7dc6f3-8166-4f3a-ae51-7b6671dc6c4d tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.345157 Jun 21 05:56:46.846916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 218/419] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:56:46 2022] POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:56:46.863410 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:46.864660 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:46.884081 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.886167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.891075 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:46.891886 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:46.983280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81262a5bbc824136ba8d940442dfae66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88247de6a0dc4a1089749816533eabd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:46.996896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a9318e73-04e8-40fc-b65e-8d5b0ca52ce9 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 200 len: 1305 microversion: 2.1 time: 0.487974 Jun 21 05:56:46.997524 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 202/420] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:46 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 1305 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:47.175882 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:47.176923 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:47.188289 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:47.188769 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:47.190991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:47.192651 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:47.474072 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:47.487519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3c0d1739-e1a6-4cb7-8787-ba0b4cb52ae5 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1710 microversion: 2.1 time: 0.636354 Jun 21 05:56:47.488134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 219/421] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:46 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1710 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:47.515907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:47.516801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:47.531748 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:47.532199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:47.532990 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:47.533452 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:47.611580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:47.626360 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:47.631576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:47.633391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-29c0fe03-1787-4ba0-8457-830c3b9af8b3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1744 microversion: 2.20 time: 0.461976 Jun 21 05:56:47.634675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 203/422] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:47 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1744 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:47.641632 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:47.642596 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:47.661169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:47.661960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:47.665904 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:47.666845 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:47.756617 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:47.781261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1ec4fad0-a68f-4d8e-bb33-1af1ea82efa2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1298 microversion: 2.1 time: 0.269846 Jun 21 05:56:47.784638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 220/423] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:47 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1298 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:48.015158 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:48.016363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] [instance: a63ea319-e39c-4ed2-abd2-8a7d0e6067e9] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:48.029285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.030551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:48.032166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.032820 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:48.049264 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] HTTP exception thrown: Instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 could not be found. Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Request method failure captured: Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 HTTP/1.1 Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV2AW_qEpyuVL3Zq-5-z5mhXDdaExGw2o75vBjEP18OG_nGSOXCsZsld3cyljmiupDSp4UBvsyXCI-mj4vVFDgfYbof7QRA6lKPW5ly9zHzodfIz_Q3DqyVy95_fDZ7mfv5HVNCyvJjLWK8kgdeOB0QyBAZ59BOME7CJTotODQuNehU Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 88247de6a0dc4a1089749816533eabd2 Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesNegativeTest-270862761 Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:56:48.051870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88247de6a0dc4a1089749816533eabd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/88247de6a0dc4a1089749816533eabd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_88247de6a0dc4a1089749816533eabd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/88247de6a0dc4a1089749816533eabd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesNegativeTest-270862761 Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 88247de6a0dc4a1089749816533eabd2 Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesNegativeTest-270862761 Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesNegativeTest-270862761-project Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 81262a5bbc824136ba8d940442dfae66 Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesNegativeTest-270862761-project Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 could not be found. Jun 21 05:56:48.053416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'a63ea319-e39c-4ed2-abd2-8a7d0e6067e9'} Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 could not be found. Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:56:48.054233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 could not be found. Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 could not be found. Jun 21 05:56:48.056739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:56:48.059985 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] Returning 404 to user: Instance a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:56:48.061096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-57b5c23d-9694-4520-a567-d334a14c8900 tempest-VolumesNegativeTest-270862761 tempest-VolumesNegativeTest-270862761-project] 10.222.0.18 "GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9" status: 404 len: 111 microversion: 2.1 time: 0.050209 Jun 21 05:56:48.062096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 221/424] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:48 2022] GET /compute/v2.1/servers/a63ea319-e39c-4ed2-abd2-8a7d0e6067e9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 05:56:48.141526 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:48.156411 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-95c535c0-72c6-4008-97ba-1f3f6f7fde20 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.520000 Jun 21 05:56:48.162643 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 204/425] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:47 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:48.512981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:48.513603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:48.532433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.532893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:48.533710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.534223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:48.537118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-fd3ace34-08b1-48b2-90c4-5a3ad717463f req-1a64a95d-8cb3-4290-b154-a4502198eb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "name": "network-vif-plugged", "status": "completed", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:48.557621 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-fd3ace34-08b1-48b2-90c4-5a3ad717463f req-1a64a95d-8cb3-4290-b154-a4502198eb4d service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.562299 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-fd3ace34-08b1-48b2-90c4-5a3ad717463f req-1a64a95d-8cb3-4290-b154-a4502198eb4d service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:48.602010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-fd3ace34-08b1-48b2-90c4-5a3ad717463f req-1a64a95d-8cb3-4290-b154-a4502198eb4d service nova] Creating event network-vif-plugged:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:56:48.613089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-fd3ace34-08b1-48b2-90c4-5a3ad717463f req-1a64a95d-8cb3-4290-b154-a4502198eb4d service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078428 Jun 21 05:56:48.618213 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 205/426] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:56:48.665837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:48.670920 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:48.681521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.682622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:48.687052 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:48.687651 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:49.150445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:49.170767 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e6791f10-0c7c-4727-8ea5-702e18812b64 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1710 microversion: 2.1 time: 0.664383 Jun 21 05:56:49.171816 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 222/427] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:48 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1710 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:49.181878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:49.183433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:49.199262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:49.199807 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:49.200689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:49.203630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:49.278841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:49.301440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:49.303318 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:49.305575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-96c2d414-2722-46dc-aa97-c9474de5d6ac tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.656533 Jun 21 05:56:49.306386 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 206/428] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:48 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:49.321744 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:49.322891 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:49.333547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:49.340512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:49.341806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:49.342507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:49.692951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:49.703942 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-89bebd19-245a-4862-8923-f963783b40c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.529867 Jun 21 05:56:49.705571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 223/429] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:49 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:49.720128 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:49.739332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-97f24e3c-598a-4cd7-a711-842697fc7f49 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.431646 Jun 21 05:56:49.761417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 207/430] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:49 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:50.206744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:50.207800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:50.246428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:50.265172 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:50.268009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:50.269579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:50.310996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-98400714", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "151c610c-93dc-48d7-b97e-bb2c574c07b6"}], "security_groups": [{"name": "tempest-securitygroup--1230919173"}], "key_name": "tempest-keypair-141764244", "user_data": "}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:50.746383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:50.787259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b44b42aa-9e4e-47ed-ae9b-20fd37ec8854 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1710 microversion: 2.1 time: 0.598880 Jun 21 05:56:50.794972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 224/431] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:50 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1710 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:50.821710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:50.828567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:50.863829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:50.866289 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:50.881542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:50.883755 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:51.329298 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] validate_networks() for [('151c610c-93dc-48d7-b97e-bb2c574c07b6', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:56:51.441353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:51.455641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:51.457640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:51.463792 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-aebc4645-4877-44f2-868e-04c7c8288b69 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.667062 Jun 21 05:56:51.464871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 225/432] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:50 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:51.502657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-ce058ff6-eda4-49e8-b784-afb05281f461 req-354acb86-7d74-4b82-b171-a8e1aa34ed63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9851de87-ca54-48bd-b009-b0a63a71afab", "tag": "46108e94-c618-4d19-9056-d3d30d571f57"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:51.520389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ce058ff6-eda4-49e8-b784-afb05281f461 req-354acb86-7d74-4b82-b171-a8e1aa34ed63 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:51.524297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ce058ff6-eda4-49e8-b784-afb05281f461 req-354acb86-7d74-4b82-b171-a8e1aa34ed63 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:51.557718 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-ce058ff6-eda4-49e8-b784-afb05281f461 req-354acb86-7d74-4b82-b171-a8e1aa34ed63 service nova] Creating event network-changed:46108e94-c618-4d19-9056-d3d30d571f57 for instance 9851de87-ca54-48bd-b009-b0a63a71afab on hv-cinder-84690 Jun 21 05:56:51.573225 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-ce058ff6-eda4-49e8-b784-afb05281f461 req-354acb86-7d74-4b82-b171-a8e1aa34ed63 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106813 Jun 21 05:56:51.575198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 226/433] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:51.581840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:51.589388 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:51.607356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:51.607808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:51.608661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:51.608997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.087768 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:52.105391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1af8c9d0-443f-4b28-a803-9f7f37780f56 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.527447 Jun 21 05:56:52.106012 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 227/434] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:51 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:52.123140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:52.123756 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:52.130301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.130754 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.131542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.132035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.386876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:52.406131 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-61c4a580-18e3-4742-bdd6-abd878bdeb16 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.297913 Jun 21 05:56:52.407354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 228/435] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:52 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:52.414165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-5c19185f-ddc8-44df-99cd-b60cf9b58d75 req-8a8da9a1-8547-4d47-859b-c378368d66d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a1f275-13ca-4db4-8350-f3b2b5ab7c15", "tag": "5b93abaa-a3c8-4631-85ba-8cadb9fe7757"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:52.423694 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-5c19185f-ddc8-44df-99cd-b60cf9b58d75 req-8a8da9a1-8547-4d47-859b-c378368d66d1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.424718 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-5c19185f-ddc8-44df-99cd-b60cf9b58d75 req-8a8da9a1-8547-4d47-859b-c378368d66d1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.447144 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-5c19185f-ddc8-44df-99cd-b60cf9b58d75 req-8a8da9a1-8547-4d47-859b-c378368d66d1 service nova] Creating event network-changed:5b93abaa-a3c8-4631-85ba-8cadb9fe7757 for instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 on hv-cinder-84690 Jun 21 05:56:52.460582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-5c19185f-ddc8-44df-99cd-b60cf9b58d75 req-8a8da9a1-8547-4d47-859b-c378368d66d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051602 Jun 21 05:56:52.462043 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 229/436] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:52.477008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:52.478513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:52.497405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.499207 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.500184 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.503909 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.549325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=4 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:52.617770 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:56:52.618642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:56:52.619468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:56:52.622276 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:56:52.623142 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:56:52.641408 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.642223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.643389 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.644376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.675686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:56:52.681687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Getting quotas for user f2d23615fd6349e1b70fdbad64b89b78 and project 7050c81c7efe4c0199573adc5687e9c0. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:56:52.697675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:56:52.702083 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:56:52.767151 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7e9e5aae-335e-4174-9a42-e71a1be8f2ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.475010 Jun 21 05:56:52.768583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 208/437] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:56:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 2478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:56:52.775681 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:52.776749 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:52.787492 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.788519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.790285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:52.791385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:52.932990 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:52.962322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5b6dc18a-f842-439c-a3e7-9780173b1598 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1714 microversion: 2.1 time: 0.492832 Jun 21 05:56:52.980927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 230/438] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:52 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1714 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:52.996496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-88afc4fb-772d-4cec-a45e-9b6028d3ab09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:52.997999 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-88afc4fb-772d-4cec-a45e-9b6028d3ab09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:53.380961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=8 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:53.766252 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-88afc4fb-772d-4cec-a45e-9b6028d3ab09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:53.777477 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-88afc4fb-772d-4cec-a45e-9b6028d3ab09 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1243 microversion: 2.1 time: 0.789192 Jun 21 05:56:53.778095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 231/439] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:52 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1243 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:53.785378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:53.790548 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:53.811229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:53.812029 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:53.819724 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:53.820520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:54.204638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:54.220805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:54.223077 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:54.224708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b4c2814a-7d6d-47d6-8114-375415586a60 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 1.454851 Jun 21 05:56:54.225497 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 209/440] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:52 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:54.242412 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:54.243521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:54.252021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:54.269875 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:54.270864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:54.271318 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:54.480598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:54.490220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8e23c1a1-3d0f-4941-b109-8d38368e9aa4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.708468 Jun 21 05:56:54.492290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 232/441] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:53 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:54.643939 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:54.660635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6ca1507b-1199-4976-bf29-00e0074d7b31 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.425519 Jun 21 05:56:54.664445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 210/442] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:54 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:54.809810 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:54.815744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:54.830057 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:54.830741 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:54.833306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:54.834205 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:54.953743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:54.962351 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-081c678c-2fed-4469-a52a-6906501a9d56 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1239 microversion: 2.1 time: 0.162961 Jun 21 05:56:54.963159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 233/443] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:54 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1239 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:55.248660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:55.249609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:55.276843 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:55.277621 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:55.282268 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:55.283041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:55.512629 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:55.527481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:55.538338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:55.540287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:55.542286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:55.544495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:55.748950 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:55.762692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:55.765460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:55.766977 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1ea45000-1034-4543-9d65-7e6d3f25f348 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.527166 Jun 21 05:56:55.768090 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 211/444] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:55 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:55.784786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:55.785712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:55.793832 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:55.794642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:55.795647 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:55.796460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:56.244886 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:56.313321 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0f7e0e66-bbe4-436b-b0fa-54de071c334c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.806536 Jun 21 05:56:56.322162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 234/445] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:55 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:56.346348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:56.347681 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:56.361115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:56.362611 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:56.364757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:56.366125 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:56.578387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:56.602556 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-32489fd8-f9d3-4692-bee5-067262e0ef7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1313 microversion: 2.1 time: 0.276823 Jun 21 05:56:56.608067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 235/446] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:56 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:56.617117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:56.636301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-36bd5c38-f7ca-4abd-a82f-0dfdd1d8fdf9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.859926 Jun 21 05:56:56.637266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 212/447] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:55 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:56.815189 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:56.817229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:56.863415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:56.865437 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:56.869618 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:56.873593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.347580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:57.348604 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:57.370291 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.371161 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.374642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.375406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.426245 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:57.430557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:57.446062 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:57.454120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:57.455531 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-61e9768a-ebf1-4835-848d-a1d37b001df0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.672590 Jun 21 05:56:57.465186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 236/448] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:56 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:56:57.602241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-a2fb4b95-769d-4e38-8f5a-f3772d02fa73 req-0e5adb26-b8df-4847-b98c-9f83b68d918b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9851de87-ca54-48bd-b009-b0a63a71afab", "name": "network-vif-plugged", "status": "completed", "tag": "46108e94-c618-4d19-9056-d3d30d571f57"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:57.623784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a2fb4b95-769d-4e38-8f5a-f3772d02fa73 req-0e5adb26-b8df-4847-b98c-9f83b68d918b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.635331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a2fb4b95-769d-4e38-8f5a-f3772d02fa73 req-0e5adb26-b8df-4847-b98c-9f83b68d918b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.684484 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-a2fb4b95-769d-4e38-8f5a-f3772d02fa73 req-0e5adb26-b8df-4847-b98c-9f83b68d918b service nova] Creating event network-vif-plugged:46108e94-c618-4d19-9056-d3d30d571f57 for instance 9851de87-ca54-48bd-b009-b0a63a71afab on hv-cinder-84690 Jun 21 05:56:57.702762 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-a2fb4b95-769d-4e38-8f5a-f3772d02fa73 req-0e5adb26-b8df-4847-b98c-9f83b68d918b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105347 Jun 21 05:56:57.703738 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 237/449] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:56:57.711498 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:57.732569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:57.741045 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.754695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.755920 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.758180 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.768149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:57.779180 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-69df9f93-b6ca-40ab-b47b-66dd66305404 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.437353 Jun 21 05:56:57.790186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 213/450] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:57 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:57.809666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:57.811887 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:57.831216 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.843506 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:57.845034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:57.850603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:58.017198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:58.031757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7c54c789-1560-4b72-9a15-d0320ba58ec8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1301 microversion: 2.1 time: 0.324159 Jun 21 05:56:58.045055 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 238/451] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:57 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1301 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:58.484648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:58.497140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:58.499617 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:58.507296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9c8061d3-8465-40b2-81a5-a22faf3ca8b2 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.714156 Jun 21 05:56:58.515576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 214/452] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:57 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:58.516851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:58.517421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:58.519959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:58.520529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:58.799992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:58.801530 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:58.809404 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:58.819705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:58.829173 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:58.832067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:58.836555 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:58.837246 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:58.847471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:58.848792 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-590c2b33-814f-4cc7-b0f3-e8d4d2a3d78d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.357077 Jun 21 05:56:58.870168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 239/453] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:58 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:56:58.885879 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:56:59.050479 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:59.051072 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:59.071848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:59.072577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:59.074592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:59.077094 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:59.453050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:59.470826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ec7f83c4-2579-46ac-8f8c-101696d70111 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.674378 Jun 21 05:56:59.487750 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 215/454] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:58 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:56:59.550279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:59.550279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:56:59.562543 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:59.563319 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:59.564322 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:59.566336 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:59.861486 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:56:59.873026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0f3ef961-dabe-4e06-b537-e5f9d86b85ba tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.825834 Jun 21 05:56:59.874445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 240/455] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:59 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:56:59.888070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-055b2e99-cd4f-46c8-9617-71ba36606e7c req-5583bdec-8029-4658-87ba-449b41755a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a1f275-13ca-4db4-8350-f3b2b5ab7c15", "name": "network-vif-plugged", "status": "completed", "tag": "5b93abaa-a3c8-4631-85ba-8cadb9fe7757"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:56:59.915583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-055b2e99-cd4f-46c8-9617-71ba36606e7c req-5583bdec-8029-4658-87ba-449b41755a43 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:56:59.924908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-055b2e99-cd4f-46c8-9617-71ba36606e7c req-5583bdec-8029-4658-87ba-449b41755a43 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:56:59.956856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-055b2e99-cd4f-46c8-9617-71ba36606e7c req-5583bdec-8029-4658-87ba-449b41755a43 service nova] Creating event network-vif-plugged:5b93abaa-a3c8-4631-85ba-8cadb9fe7757 for instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 on hv-cinder-84690 Jun 21 05:56:59.968111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-055b2e99-cd4f-46c8-9617-71ba36606e7c req-5583bdec-8029-4658-87ba-449b41755a43 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092214 Jun 21 05:56:59.968724 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 241/456] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:56:59.986601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:56:59.987712 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:00.005693 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:00.006465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:00.007451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:00.008026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:00.104991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:00.139708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cb632851-6032-47a2-8e79-b2b519943543 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1318 microversion: 2.1 time: 0.597170 Jun 21 05:57:00.158299 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 216/457] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:56:59 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:00.275363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:00.291229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:00.293632 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:00.296656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-327484f3-1865-4dd0-808d-c2dcc721c7b6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.326651 Jun 21 05:57:00.297493 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 242/458] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:56:59 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:00.511818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:00.518519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:00.540097 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:00.541170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:00.542777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:00.543885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:00.877410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:00.891719 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-616fdc5a-4fe5-489d-9d2b-c37605151f21 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.389397 Jun 21 05:57:00.893146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 217/459] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:00 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:00.902344 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:00.903405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:00.914219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:00.914877 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:00.916452 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:00.917160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:01.176451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:01.178311 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:01.190877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:01.191757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:01.192872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:01.193545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:01.447025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:01.471917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0d07ad3d-ab66-4e54-b777-3b72bcb5b747 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.572615 Jun 21 05:57:01.482783 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 243/460] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:00 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:01.488855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:01.491391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:01.512976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:01.513434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:01.514268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:01.514707 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:02.057627 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:02.068616 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8aaf0ecb-aac8-4801-add0-5511e1a4126e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1507 microversion: 2.1 time: 0.902854 Jun 21 05:57:02.069975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 218/461] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:01 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1507 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:02.083095 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-e2c764ac-af75-48a4-b827-78668f03dd5e req-a35043fc-ff37-4a3e-815c-dfef339f11a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84283f84-8793-4072-8e32-bfec2d2035f2", "tag": "ac21a55c-508f-45cb-96cc-44152b7643dd"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:02.106256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-e2c764ac-af75-48a4-b827-78668f03dd5e req-a35043fc-ff37-4a3e-815c-dfef339f11a3 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:02.106828 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-e2c764ac-af75-48a4-b827-78668f03dd5e req-a35043fc-ff37-4a3e-815c-dfef339f11a3 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:02.140190 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-e2c764ac-af75-48a4-b827-78668f03dd5e req-a35043fc-ff37-4a3e-815c-dfef339f11a3 service nova] Creating event network-changed:ac21a55c-508f-45cb-96cc-44152b7643dd for instance 84283f84-8793-4072-8e32-bfec2d2035f2 on hv-cinder-84690 Jun 21 05:57:02.153730 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-e2c764ac-af75-48a4-b827-78668f03dd5e req-a35043fc-ff37-4a3e-815c-dfef339f11a3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078357 Jun 21 05:57:02.158519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 219/462] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:02.178008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:02.191285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:02.222458 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:02.223098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:02.224201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:02.228906 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:02.283625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:02.321789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:02.331505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:02.344357 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5a7d396b-1bb4-4508-80f9-045ebfafbb4a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.856981 Jun 21 05:57:02.348649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 244/463] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:01 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:02.501392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:02.517597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:02.549302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:02.559070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:02.562653 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:02.564449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:02.567572 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:02.605360 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a35e9d47-35e6-4b36-a331-d9b1e49dd634 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1365 microversion: 2.1 time: 0.436245 Jun 21 05:57:02.612046 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 220/464] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:02 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1365 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:03.377076 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:03.379031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:03.388327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:03.394867 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=22 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:03.429495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:03.437971 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:03.440308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:03.443878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:03.445868 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:03.446907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a2e86704-cd2c-4dba-a45e-83e1eb754a0e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.959425 Jun 21 05:57:03.448072 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 245/465] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:02 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:03.631319 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:03.632678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:03.649123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:03.650834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:03.651959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:03.652650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:03.773562 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:04.136843 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:04.155249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:04.166476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:04.170476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ca299f63-b5ef-45ed-941a-8f5e3f69b7a5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.806415 Jun 21 05:57:04.174347 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 221/466] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:03 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:04.446979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:04.457044 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-94b6b1b0-a610-4e8c-b9a5-26657a3193f5 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1555 microversion: 2.1 time: 0.829791 Jun 21 05:57:04.468965 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:04.469893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:04.475097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 246/467] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:03 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1555 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:04.488245 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:04.488691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:04.489880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:04.490535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:04.499516 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:04.500263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:04.513170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:04.513923 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:04.520928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:04.523682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:04.779564 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bb4438c1-fbdf-4b48-b43c-e857af9c4bf4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.286301 Jun 21 05:57:04.780353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 247/468] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:57:04 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/os-interface => generated 284 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:57:04.846799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:04.862114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3fefbd2a-1f38-43dc-981d-d23311920b7f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.394328 Jun 21 05:57:04.863400 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 222/469] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:04 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:05.195222 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:05.196404 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:05.209262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:05.211386 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:05.216499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:05.217393 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:05.576179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:05.588905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:05.592038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:05.594271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9545dbf9-0c00-49e5-b5f2-3a8d56937cb6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.404627 Jun 21 05:57:05.595394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 248/470] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:05 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:05.881548 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:05.882332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:05.891290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:05.895766 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:05.896922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:05.899782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:06.289185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:06.306461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b9f81787-94b3-42c0-9d18-1977c1f906ad tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.429235 Jun 21 05:57:06.307410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 223/471] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:05 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:06.618758 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:06.620282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:06.630661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:06.633695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:06.634784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:06.635454 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:06.897310 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-c688ff93-eded-47c0-9767-de20c3322c6d req-cc6e2e5f-2d62-4a2c-a2f3-7fc021d81624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a1f275-13ca-4db4-8350-f3b2b5ab7c15", "tag": "5b93abaa-a3c8-4631-85ba-8cadb9fe7757"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:06.914364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-c688ff93-eded-47c0-9767-de20c3322c6d req-cc6e2e5f-2d62-4a2c-a2f3-7fc021d81624 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:06.919661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-c688ff93-eded-47c0-9767-de20c3322c6d req-cc6e2e5f-2d62-4a2c-a2f3-7fc021d81624 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:06.966827 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-c688ff93-eded-47c0-9767-de20c3322c6d req-cc6e2e5f-2d62-4a2c-a2f3-7fc021d81624 service nova] Creating event network-changed:5b93abaa-a3c8-4631-85ba-8cadb9fe7757 for instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 on hv-cinder-84690 Jun 21 05:57:06.977874 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-c688ff93-eded-47c0-9767-de20c3322c6d req-cc6e2e5f-2d62-4a2c-a2f3-7fc021d81624 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084422 Jun 21 05:57:06.980047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 224/472] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:57:07.067229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:07.130394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:07.141703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:07.152387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5d91497c-12a8-4d47-a97b-3f99df179e24 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.536414 Jun 21 05:57:07.153997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 249/473] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:06 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:57:07.329744 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:07.330983 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:07.356065 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:07.359239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:07.363651 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:07.364449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:08.018379 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:08.045610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1ddae24c-2d64-40aa-b176-785e6823b6c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.723770 Jun 21 05:57:08.046971 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 225/474] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:07 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:08.184370 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:08.185786 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:08.200642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:08.201506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:08.202875 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:08.203630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:08.854942 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:08.899740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:08.915796 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:08.924905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3dc8d333-7a78-461a-a0ea-cf89721a93f2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.742425 Jun 21 05:57:08.952164 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 250/475] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:08 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:09.075319 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:09.076112 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:09.087233 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:09.099965 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:09.102613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:09.106693 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:09.588598 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:09.619745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6acdfd76-c526-4c0b-a839-001ca33d5f19 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.548041 Jun 21 05:57:09.620774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 226/476] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:09 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:09.960379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:09.961806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:09.976113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:09.978299 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:09.987475 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:09.988229 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:10.486086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:10.505814 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:10.507554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:10.508848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-65d376c6-6f18-420d-bf62-429f20f60248 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1739 microversion: 2.20 time: 0.553264 Jun 21 05:57:10.510208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 251/477] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:09 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1739 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:10.651011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:10.653500 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:10.665475 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:10.666736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:10.668581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:10.669645 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:10.862485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:10.871407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6a6dfcad-b426-489e-b126-1c8fe8dc0b87 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.228420 Jun 21 05:57:10.872597 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 227/478] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:10 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:11.529894 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:11.530736 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:11.540651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:11.542632 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:11.546160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:11.546647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:11.883182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:11.894031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:11.894892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:11.897858 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:11.900080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:11.901686 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9c4a479f-766b-44bc-ae79-330cef2d1eeb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1721 microversion: 2.20 time: 0.375901 Jun 21 05:57:11.903066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 252/479] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:11 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1721 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:11.907744 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:11.908488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:11.909601 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:11.919493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:12.098991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-c13defc2-6b75-483e-a2e6-ed5aa27cb90a req-41bbdeea-7a9c-430d-8e65-cfdcc0d9d01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84283f84-8793-4072-8e32-bfec2d2035f2", "name": "network-vif-plugged", "status": "completed", "tag": "ac21a55c-508f-45cb-96cc-44152b7643dd"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:12.111398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-c13defc2-6b75-483e-a2e6-ed5aa27cb90a req-41bbdeea-7a9c-430d-8e65-cfdcc0d9d01b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:12.112251 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-c13defc2-6b75-483e-a2e6-ed5aa27cb90a req-41bbdeea-7a9c-430d-8e65-cfdcc0d9d01b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:12.134414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-c13defc2-6b75-483e-a2e6-ed5aa27cb90a req-41bbdeea-7a9c-430d-8e65-cfdcc0d9d01b service nova] Creating event network-vif-plugged:ac21a55c-508f-45cb-96cc-44152b7643dd for instance 84283f84-8793-4072-8e32-bfec2d2035f2 on hv-cinder-84690 Jun 21 05:57:12.141309 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-c13defc2-6b75-483e-a2e6-ed5aa27cb90a req-41bbdeea-7a9c-430d-8e65-cfdcc0d9d01b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047667 Jun 21 05:57:12.142678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 253/480] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:12.242913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:12.253760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b582d17f-4a3f-4604-803e-52e75d39ba89 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.364483 Jun 21 05:57:12.254644 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 228/481] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:11 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:57:12.923162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:12.924149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:12.933800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:12.934654 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:12.936518 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:12.937215 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:13.156320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:13.183521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:13.186296 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:13.190403 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3091eeef-59ec-4fae-a227-74f49a2caae2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1721 microversion: 2.20 time: 0.272501 Jun 21 05:57:13.192061 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 254/482] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:12 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:13.272509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:13.273721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:13.282366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:13.283094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:13.284940 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:13.285573 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:13.549587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:13.561871 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-876a724e-b38e-49f7-a949-968b7819ae41 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.293246 Jun 21 05:57:13.562894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 229/483] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:13 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:14.211818 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:14.212428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:14.215136 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=88 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:14.225793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:14.236777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:14.237828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:14.238315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:14.493655 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:14.497649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:14.509809 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:14.512612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:14.514199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f8983fde-bc7f-4483-9904-73fa45036bd1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1724 microversion: 2.20 time: 0.306939 Jun 21 05:57:14.515374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 255/484] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:14 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:14.532869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c71c6288-64c7-44d0-a4eb-6b7bc7beee5f"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:14.534047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:14.558741 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:14.559616 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:14.570511 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:14.571142 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:14.583782 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:14.584434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:14.603982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:14.604443 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:14.605282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:14.605715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:14.909879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:14.927319 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-73ac6a8f-9bbd-4b18-b3dd-96308fea2287 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.351379 Jun 21 05:57:14.930343 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 256/485] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:14 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:15.177785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:15.187289 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b20c58a7-d697-493c-b9e1-f892cbb1856d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.658408 Jun 21 05:57:15.188745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 230/486] 10.222.0.18 () {62 vars in 1363 bytes} [Tue Jun 21 05:57:14 2022] POST /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments => generated 188 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:57:15.349464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:15.352732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:15.366472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:15.369445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:15.370541 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:15.370973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:15.488025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6e214cc0-90b3-4e10-bffd-3e0ff42ab6a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/action" status: 202 len: 0 microversion: 2.20 time: 0.143913 Jun 21 05:57:15.488675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 257/487] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 21 05:57:15 2022] POST /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:57:15.500675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:15.501820 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:15.515284 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:15.515776 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:15.516615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:15.517117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:15.860021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:15.876972 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:15.879554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:15.881865 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-783f165c-a596-4e61-bd0d-c20851c10788 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1750 microversion: 2.20 time: 0.385635 Jun 21 05:57:15.896147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 231/488] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:15 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1750 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:15.950959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:15.951958 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:15.965261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:15.966204 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:15.969384 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:15.971202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:16.196208 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-9db8430f-4df4-4896-9e2e-a40b4a60d96f req-0b4403f2-2341-4123-bdbe-083608c8a7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "name": "network-vif-unplugged", "status": "completed", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:16.211894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-9db8430f-4df4-4896-9e2e-a40b4a60d96f req-0b4403f2-2341-4123-bdbe-083608c8a7f9 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:16.212928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-9db8430f-4df4-4896-9e2e-a40b4a60d96f req-0b4403f2-2341-4123-bdbe-083608c8a7f9 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:16.254932 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.compute.server_external_events [req-9db8430f-4df4-4896-9e2e-a40b4a60d96f req-0b4403f2-2341-4123-bdbe-083608c8a7f9 service nova] Unable to find a host for instance ec84758b-79f0-4883-8081-9b2b09d7b812. Dropping event network-vif-unplugged {{(pid=117430) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 05:57:16.256584 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-9db8430f-4df4-4896-9e2e-a40b4a60d96f req-0b4403f2-2341-4123-bdbe-083608c8a7f9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.066733 Jun 21 05:57:16.263554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 232/489] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 05:57:16.357243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:16.375767 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dacc556a-d9e9-4909-967b-b2357676390d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1369 microversion: 2.1 time: 0.432533 Jun 21 05:57:16.377446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 258/490] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:15 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1369 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:16.902679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:16.903885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:16.909804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:16.911905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:16.912880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:16.913840 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:16.914321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:17.290661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:17.308093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:17.311179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:17.314063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ca458c36-994e-42dc-95bb-a242cee0c76a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1750 microversion: 2.20 time: 0.414316 Jun 21 05:57:17.315290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 233/491] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:16 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1750 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:17.394281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:17.395924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:17.408014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:17.408856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:17.409800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:17.410495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:17.656233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:17.676797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-343f5787-02e1-4e10-8376-0304e45c7885 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1563 microversion: 2.1 time: 0.287357 Jun 21 05:57:17.678691 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 259/492] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:17 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1563 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:17.696432 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:17.697025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:17.706426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:17.706871 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:17.707896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:17.708395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:17.816586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-25f4632b-f517-4cae-85aa-21227e130c21 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124611 Jun 21 05:57:17.817279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 234/493] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:57:17 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:18.333964 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:18.334669 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:18.344111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:18.345210 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:18.348937 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:18.350507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:18.561525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:18.572817 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:18.574755 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:18.576348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-03c5d3b5-6917-4132-aff0-e9a68affa455 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1752 microversion: 2.20 time: 0.246942 Jun 21 05:57:18.577478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 260/494] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:18 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1752 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:18.654951 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ae3224b3-0e3c-48ae-bcfd-bee6cbffbfac tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Action: 'create', calling method: .version_select at 0x7efe5c8f4820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1550044513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCnyPOXLPhUBkz0yZtqNGe6tYlWZLDrcYnOx1gMGfhMgrmoOEnWm7mFixi47YaFg9QpJbGUF/OhM+ERh518MVXAqEyPzd6ZmHE22PoiSRpIK66Y344BfrENdDYq0wAEyw=="}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:18.671557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-ae3224b3-0e3c-48ae-bcfd-bee6cbffbfac tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Getting quotas for project 4e17d31f99954cca8b4eb24b3b798f1e. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:57:18.675953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-ae3224b3-0e3c-48ae-bcfd-bee6cbffbfac tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Getting quotas for user 353add140e784d90a16c124e52f5d36d and project 4e17d31f99954cca8b4eb24b3b798f1e. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:57:18.711123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ae3224b3-0e3c-48ae-bcfd-bee6cbffbfac tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235985 Jun 21 05:57:18.718186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 235/495] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:57:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:19.227502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-7737d74e-d2d4-4365-b1f9-9d809456d260 req-e0aee0ce-fdd3-4fb4-9e80-60ac3f570de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84283f84-8793-4072-8e32-bfec2d2035f2", "tag": "ac21a55c-508f-45cb-96cc-44152b7643dd"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:19.245926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-7737d74e-d2d4-4365-b1f9-9d809456d260 req-e0aee0ce-fdd3-4fb4-9e80-60ac3f570de0 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:19.246247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-7737d74e-d2d4-4365-b1f9-9d809456d260 req-e0aee0ce-fdd3-4fb4-9e80-60ac3f570de0 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:19.261805 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-7737d74e-d2d4-4365-b1f9-9d809456d260 req-e0aee0ce-fdd3-4fb4-9e80-60ac3f570de0 service nova] Creating event network-changed:ac21a55c-508f-45cb-96cc-44152b7643dd for instance 84283f84-8793-4072-8e32-bfec2d2035f2 on hv-cinder-84690 Jun 21 05:57:19.270340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-7737d74e-d2d4-4365-b1f9-9d809456d260 req-e0aee0ce-fdd3-4fb4-9e80-60ac3f570de0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054776 Jun 21 05:57:19.271103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 261/496] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:19.603544 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:19.604881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:19.611894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:19.612793 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:19.613794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:19.614888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:19.843346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:19.860069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:19.863984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:19.866098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0f66f7cc-9a49-4108-815d-4720bb14332f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.273822 Jun 21 05:57:19.867606 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 236/497] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:19 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:20.082048 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74bb4f53-370e-4a32-a447-851fd92e421b", "device": "/dev/sdb"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:20.086900 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:20.097474 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:20.098564 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:20.100719 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:20.102703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:20.548880 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4f2be200-1eaf-411b-817f-e9a6f0e94ff7 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "POST /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.473297 Jun 21 05:57:20.556426 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 262/498] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:57:20 2022] POST /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:20.896661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:20.897758 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:20.920527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:20.921334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:20.922760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:20.923513 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:21.188160 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:21.197894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:21.199663 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:21.200863 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-749034ff-c96d-4995-b486-4507ab694944 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.312070 Jun 21 05:57:21.202024 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 237/499] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:20 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:22.227670 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:22.228460 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:22.239692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:22.240161 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:22.241666 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:22.242261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:22.524473 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:22.534786 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:22.537560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:22.539242 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dcaffe3c-5593-41c0-9e7a-7c454b3721d4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.317512 Jun 21 05:57:22.540633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 263/500] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:22 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:57:23.563117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:23.564481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:23.580347 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:23.580876 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:23.581734 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:23.582272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:23.811156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:23.831679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:23.835366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:23.838440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-73fbdaac-681b-4d91-a045-93eb440576b0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.281995 Jun 21 05:57:23.839384 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 238/501] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:23 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:24.866414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:24.867237 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:24.874504 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:24.874944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:24.875928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:24.876361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:25.073464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:25.088336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:25.090247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:25.091651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-00eae87f-fbd1-4846-8357-cb4b176def23 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.231881 Jun 21 05:57:25.092373 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 264/502] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:24 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:26.121281 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:26.123260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:26.130702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:26.131718 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:26.132720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:26.133362 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:26.307047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:26.324299 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:26.326480 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:26.328801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-10e5497a-0b22-4a31-8b68-25596f43ddd6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.211127 Jun 21 05:57:26.329880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 239/503] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:26 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:27.350873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:27.352017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:27.365263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:27.365801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:27.366718 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:27.367177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:27.569514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:27.585558 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:27.587104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:27.588386 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cbe2789e-de75-44c0-92fe-da95a12fdafe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.243426 Jun 21 05:57:27.589982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 265/504] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:27 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:28.611111 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:28.612426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:28.619212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:28.619647 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:28.620421 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:28.620851 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:28.685214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=4 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:28.772194 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:28.781152 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:28.782706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:28.783956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-de0b7bc6-9716-458c-8d8b-fddbf9ed1e6f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.176945 Jun 21 05:57:28.787885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 240/505] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:28 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:29.803402 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:29.803998 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:29.811157 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:29.811622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:29.812390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:29.812830 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:29.980372 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:29.993439 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:29.995364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:29.996911 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1aeb2961-c77e-4fca-bc17-4d3ce7d82510 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.198074 Jun 21 05:57:29.998540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 266/506] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:29 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:31.015356 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:31.015944 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:31.022211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:31.022659 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:31.023544 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:31.023862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:31.206957 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:31.219240 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:31.222205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:31.224946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-55482a23-6b63-4f0e-9465-6304d7883eef tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.212642 Jun 21 05:57:31.225792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 241/507] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:31 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:32.243912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:32.245167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:32.252758 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:32.253619 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:32.254458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:32.255092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:32.424151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:32.434384 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:32.435866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:32.436999 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b6521a8a-a320-49f8-99a7-15ce4ec6f47c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.197508 Jun 21 05:57:32.437549 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 267/508] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:32 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:57:33.456833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:33.457431 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:33.464271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:33.464719 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:33.465479 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:33.465912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:33.607987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:33.618351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:33.619847 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:33.621051 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5d1cae68-b6ab-4b5d-bab0-3a842f5328ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.168276 Jun 21 05:57:33.621605 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 242/509] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:33 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:34.640423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:34.641018 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:34.649024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:34.649828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:34.650990 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:34.651692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:35.060679 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:35.070032 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:35.071446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:35.072620 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e1917398-ccce-4845-9579-bcd56243d9c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.436056 Jun 21 05:57:35.073165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 268/510] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:34 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:36.090819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:36.091424 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:36.097980 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:36.098430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:36.099888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:36.100323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:36.237715 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:36.246619 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:36.248114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:36.249263 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e4d32b81-18a3-4a44-b5ef-3bf16a1691b1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.162349 Jun 21 05:57:36.249816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 243/511] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:36 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:37.268026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:37.268649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:37.275940 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:37.276379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:37.277135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:37.277562 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:37.409290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:37.417735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:37.419277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:37.420430 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-64512efd-48c6-4497-933e-a0bf3900b4e5 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.156460 Jun 21 05:57:37.420989 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 269/512] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:37 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:38.439247 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:38.439866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:38.446044 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:38.446491 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:38.447254 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:38.447687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:38.576003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:38.584916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:38.586428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:38.587570 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5a56a27b-5ba3-4a64-9af8-9c4f80da5673 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.152224 Jun 21 05:57:38.588113 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 244/513] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:38 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:39.606389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:39.607013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:39.613839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:39.614313 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:39.615175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:39.615605 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:39.760721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:39.764366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:39.770441 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:39.771927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:39.773081 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cb4fcdfe-856e-47be-a405-35807cf8238f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.170992 Jun 21 05:57:39.773634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 270/514] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:39 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:40.791658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:40.792238 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:40.798364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:40.798802 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:40.799559 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:40.799984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:40.930733 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:40.939131 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:40.940626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:40.941774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b1fd1f10-cf49-4b43-825f-d428234a7dc7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.154012 Jun 21 05:57:40.942933 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 245/515] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:40 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:41.963340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:41.964023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:41.972534 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:41.972968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:41.973778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:41.974236 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:42.111051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:42.120434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:42.121955 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:42.123118 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-98da3b4d-4e13-482f-b7ad-97266a150799 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.166347 Jun 21 05:57:42.123675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 271/516] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:41 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:43.142047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:43.142648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:43.148816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:43.149258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:43.150032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:43.150461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:43.279816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:43.288725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:43.290241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:43.291397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-469568d9-c4b6-4033-af07-6e5ba51fd1e2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.153300 Jun 21 05:57:43.291952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 246/517] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:43 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:44.314501 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:44.315935 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:44.319191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=36 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:44.325248 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:44.325779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:44.326651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:44.327181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:44.469743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:44.479509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:44.481039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:44.482253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-66e2550e-e18c-4cfa-89e6-3c26c154fee7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.175363 Jun 21 05:57:44.493752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 272/518] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:44 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:45.472970 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-533708429", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1550044513", "security_groups": [{"name": "tempest-secgroup-smoke-116586655"}], "networks": [{"uuid": "d7b0eef2-3f9a-4a04-bec5-7e0dbde92f0c"}], "block_device_mapping_v2": [{"uuid": "01072797-a948-42d1-84e8-45d239c91965", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:45.501746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:45.501746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:45.507736 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:45.508178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:45.508962 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:45.509398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:45.625015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] validate_networks() for [('d7b0eef2-3f9a-4a04-bec5-7e0dbde92f0c', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:57:45.735975 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:45.745838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:45.747462 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:45.748626 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ff39f71a-cb00-4c36-b4e1-341af4d40a15 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.252102 Jun 21 05:57:45.749186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 273/519] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:45 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:57:46.024050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:57:46.024476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:57:46.024970 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:57:46.025372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:57:46.025767 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:57:46.035326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:46.035837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:46.037137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:46.037565 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:46.044845 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=85 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:46.055665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Getting quotas for project 4e17d31f99954cca8b4eb24b3b798f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:57:46.059593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Getting quotas for user 353add140e784d90a16c124e52f5d36d and project 4e17d31f99954cca8b4eb24b3b798f1e. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:57:46.119157 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:57:46.121249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01072797-a948-42d1-84e8-45d239c91965',volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:57:46.248036 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-22b0db21-5af8-43c1-b3e5-b3c28240ab0a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.779672 Jun 21 05:57:46.248674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 247/520] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:57:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:57:46.258696 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-29e4ee44-6a64-40ed-8878-86add1eb32fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:46.259468 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-29e4ee44-6a64-40ed-8878-86add1eb32fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:46.313006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-29e4ee44-6a64-40ed-8878-86add1eb32fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:46.319891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-29e4ee44-6a64-40ed-8878-86add1eb32fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1088 microversion: 2.1 time: 0.065138 Jun 21 05:57:46.320567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 274/521] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:46 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1088 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:46.766941 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:46.767575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:46.774425 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:46.774865 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:46.775624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:46.776050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:46.912323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:46.921146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:46.922684 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:46.923838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bfd57791-5639-44ea-b519-f073e6f5a7c4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.160933 Jun 21 05:57:46.924395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 248/522] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:46 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:47.337242 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:47.337840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:47.345219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:47.345653 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:47.346434 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:47.346860 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:47.406699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:47.414888 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ccbcc8af-10aa-4e92-b84c-8177a8f7c7f3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1138 microversion: 2.1 time: 0.081457 Jun 21 05:57:47.415444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 275/523] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:47 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:47.943787 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:47.944416 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:47.946527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=4 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:47.953754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:47.954552 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:47.955375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:47.955899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:48.091581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:48.102254 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:48.103782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:48.105869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5bc553f0-b878-4c2c-9dc8-9cd0282f5b93 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.167677 Jun 21 05:57:48.106726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 249/524] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:47 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:48.415987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-a5934991-54d2-476a-b785-da1a7666f6e4 req-e233bc55-f583-4c8e-ac22-d03afdaaf307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "name": "network-vif-plugged", "status": "completed", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:48.425295 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a5934991-54d2-476a-b785-da1a7666f6e4 req-e233bc55-f583-4c8e-ac22-d03afdaaf307 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:48.426024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a5934991-54d2-476a-b785-da1a7666f6e4 req-e233bc55-f583-4c8e-ac22-d03afdaaf307 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:48.432784 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:48.433397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:48.440794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:48.441254 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:48.442589 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:48.443009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-a5934991-54d2-476a-b785-da1a7666f6e4 req-e233bc55-f583-4c8e-ac22-d03afdaaf307 service nova] Creating event network-vif-plugged:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:57:48.443146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:48.449605 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-a5934991-54d2-476a-b785-da1a7666f6e4 req-e233bc55-f583-4c8e-ac22-d03afdaaf307 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037955 Jun 21 05:57:48.450533 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 276/525] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:48.512136 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:48.520712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3c592a20-a628-4e71-acf6-15fe843540fa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1204 microversion: 2.1 time: 0.091775 Jun 21 05:57:48.530830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 250/526] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:48 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1204 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:49.125104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:49.126079 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:49.133344 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:49.134042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:49.135050 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:49.135483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:49.282760 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:49.296044 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:49.297721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:49.304087 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-47f114dd-80ee-40a7-a2cb-5f74e36484bc tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.178305 Jun 21 05:57:49.304718 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 277/527] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:49 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:49.542221 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:49.543427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:49.550158 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:49.550527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:49.551781 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:49.552409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:49.697089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:49.705416 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0c851c20-227b-4071-9c11-637d04a4f781 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.167745 Jun 21 05:57:49.706383 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 251/528] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:49 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:50.257831 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-e6612285-31a8-4501-86c6-b3680584770b req-57f88a0e-eab1-40e8-b99e-8b01b6e1646a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:50.272073 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-e6612285-31a8-4501-86c6-b3680584770b req-57f88a0e-eab1-40e8-b99e-8b01b6e1646a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:50.272572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-e6612285-31a8-4501-86c6-b3680584770b req-57f88a0e-eab1-40e8-b99e-8b01b6e1646a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:50.299929 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-e6612285-31a8-4501-86c6-b3680584770b req-57f88a0e-eab1-40e8-b99e-8b01b6e1646a service nova] Creating event network-changed:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 05:57:50.304981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-e6612285-31a8-4501-86c6-b3680584770b req-57f88a0e-eab1-40e8-b99e-8b01b6e1646a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051968 Jun 21 05:57:50.305867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 278/529] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:50.322403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:50.323005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:50.329450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:50.329897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:50.330698 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:50.331294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:50.487296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:50.499266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:50.501048 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:50.502286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-687766ef-48cd-41df-9afc-0e5f5b0663cf tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1808 microversion: 2.20 time: 0.183728 Jun 21 05:57:50.502859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 252/530] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:50 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:57:50.723688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:50.724376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:50.730656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:50.731097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:50.731847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:50.732266 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:50.867834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:50.876632 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-844a1a7e-d244-4104-8b87-5a61e5861630 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.157630 Jun 21 05:57:50.877414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 279/531] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:50 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:51.521728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:51.522320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:51.533755 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:51.534345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:51.535288 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:51.536118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:51.671010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:51.679551 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:51.681029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:51.682195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fa71e72f-628b-422d-8106-a95219c0b454 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1795 microversion: 2.20 time: 0.165143 Jun 21 05:57:51.682748 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 253/532] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:57:51 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1795 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:57:51.893703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:51.894393 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:51.902486 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:51.903008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:51.903710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:51.904227 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:52.038200 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:52.045879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-359e2a72-242b-4b41-929b-9861612ec876 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.155926 Jun 21 05:57:52.046527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 280/533] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:51 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:52.092536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:52.093096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:52.100297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:52.100752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:52.101538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:52.101998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:52.230442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lazy-loading 'services' on Instance uuid 9851de87-ca54-48bd-b009-b0a63a71afab {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:57:52.358447 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b7d40566-8ed5-4b38-b7ac-37e94b6943a5 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab/os-volume_attachments/74bb4f53-370e-4a32-a447-851fd92e421b" status: 202 len: 0 microversion: 2.1 time: 0.269252 Jun 21 05:57:52.359225 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 254/534] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 05:57:52 2022] DELETE /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab/os-volume_attachments/74bb4f53-370e-4a32-a447-851fd92e421b => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:57:53.062867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:53.063456 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:53.071474 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:53.071919 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:53.072689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:53.073112 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:53.207060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:53.215233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cf1fee73-b049-4866-90d4-6b2141e3a5d1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.156220 Jun 21 05:57:53.215789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 281/535] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:53 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:53.491059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:53.491635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:53.497873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:53.498353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:53.499108 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:53.499537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:53.525399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:57:53.601345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-38d432ab-70e7-4170-99ee-7adf3454fe42 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 204 len: 0 microversion: 2.1 time: 0.114213 Jun 21 05:57:53.602096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 255/536] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:57:53 2022] DELETE /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:57:53.610473 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:53.611097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:53.617262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:53.617699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:53.618497 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:53.618932 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:53.757323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:53.764905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8f36430f-126a-408b-9fa3-f2ae042c9716 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1513 microversion: 2.1 time: 0.158825 Jun 21 05:57:53.765472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 282/537] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:53 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:54.234985 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:54.235581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:54.241538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:54.241999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:54.242751 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:54.243179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:54.376707 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:54.384796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3b76ff24-9b89-4cb5-b314-9311fbdcaf8f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.154068 Jun 21 05:57:54.385362 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 256/538] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:54 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:54.782082 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:54.782687 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:54.789813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:54.790285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:54.791039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:54.791467 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:54.924307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:54.932400 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-088b2bab-05ce-42b3-a339-3251b65bcd1b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1513 microversion: 2.1 time: 0.154245 Jun 21 05:57:54.932968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 283/539] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:54 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:55.401752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:55.402609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:55.408898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:55.409340 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:55.410674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:55.411113 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:55.550229 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:55.559084 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f49eb212-a417-42eb-adbd-8048e7004797 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.161155 Jun 21 05:57:55.559728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 257/540] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:55 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:55.948599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:55.949212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:55.956031 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:55.956470 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:55.957890 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:55.958346 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:56.096569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:56.105498 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-75ca17c2-1ef1-4029-80d5-ecd96f0357a9 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 200 len: 1513 microversion: 2.1 time: 0.160691 Jun 21 05:57:56.106100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 284/541] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:55 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:56.355099 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-2ece33d1-d83e-4989-bb0e-ce320bfe0f58 req-222c8e1f-40f0-4b59-8f70-3f74ec1980bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9851de87-ca54-48bd-b009-b0a63a71afab", "name": "network-vif-deleted", "tag": "46108e94-c618-4d19-9056-d3d30d571f57"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:57:56.360311 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:56.360982 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=6 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:56.368286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-2ece33d1-d83e-4989-bb0e-ce320bfe0f58 req-222c8e1f-40f0-4b59-8f70-3f74ec1980bb service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:56.368721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-2ece33d1-d83e-4989-bb0e-ce320bfe0f58 req-222c8e1f-40f0-4b59-8f70-3f74ec1980bb service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:56.381717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-2ece33d1-d83e-4989-bb0e-ce320bfe0f58 req-222c8e1f-40f0-4b59-8f70-3f74ec1980bb service nova] Creating event network-vif-deleted:46108e94-c618-4d19-9056-d3d30d571f57 for instance 9851de87-ca54-48bd-b009-b0a63a71afab on hv-cinder-84690 Jun 21 05:57:56.386863 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-2ece33d1-d83e-4989-bb0e-ce320bfe0f58 req-222c8e1f-40f0-4b59-8f70-3f74ec1980bb service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Jun 21 05:57:56.387458 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 258/542] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:57:56.576297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:56.576966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:56.578948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:57:56.584512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:56.584961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:56.585728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:56.586274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:56.721704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:56.729773 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bd27451d-0bd1-47c6-b20e-452b48127812 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.157292 Jun 21 05:57:56.730368 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 285/543] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:56 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:57.122321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:57.123072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 9851de87-ca54-48bd-b009-b0a63a71afab] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:57.129640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:57.130417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:57.131191 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:57.131802 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:57.146203 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] HTTP exception thrown: Instance 9851de87-ca54-48bd-b009-b0a63a71afab could not be found. Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Request method failure captured: Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab HTTP/1.1 Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV2VhRHeMkjVydmD8S-0OmbXeOqZPMCfBaBVQ6XPCgNicxU_jL2NMXRWrlzUVz3bUCw-c4ExuZW1L5n6nTYqV2qkIoxgzYQfGK5KJ0bO7Z6pLGq34WKwF0iJk5Bb7lJcjrqgBi-I0Id8DuWLS0PrqU-XDNM4LwhRsRIs62nAm_vEjHg Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: a7e723a47d5246779d7835b9898429e1 Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1527295436 Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:57:57.147872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7e723a47d5246779d7835b9898429e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a7e723a47d5246779d7835b9898429e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a7e723a47d5246779d7835b9898429e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7e723a47d5246779d7835b9898429e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesSnapshotTestJSON-1527295436 Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: a7e723a47d5246779d7835b9898429e1 Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1527295436 Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesSnapshotTestJSON-1527295436-project Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: fc4e3249c43c4e8292475684ce7fd36e Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesSnapshotTestJSON-1527295436-project Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 9851de87-ca54-48bd-b009-b0a63a71afab could not be found. Jun 21 05:57:57.149448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '9851de87-ca54-48bd-b009-b0a63a71afab'} Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9851de87-ca54-48bd-b009-b0a63a71afab could not be found. Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:57:57.150391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9851de87-ca54-48bd-b009-b0a63a71afab could not be found. Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9851de87-ca54-48bd-b009-b0a63a71afab could not be found. Jun 21 05:57:57.151816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:57:57.153118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Returning 404 to user: Instance 9851de87-ca54-48bd-b009-b0a63a71afab could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:57:57.153118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-57cfc2ae-a3e5-4e9f-9912-bdd5e984e4e8 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab" status: 404 len: 111 microversion: 2.1 time: 0.031240 Jun 21 05:57:57.153118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 259/544] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:57 2022] GET /compute/v2.1/servers/9851de87-ca54-48bd-b009-b0a63a71afab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:57:57.747162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:57.747776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:57.754418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:57.754858 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:57.755616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:57.756073 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:57.889847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:57.898015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a8895bdc-58c1-4c34-bdd6-ce48687c4731 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.154716 Jun 21 05:57:57.898584 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 286/545] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:57 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:57:58.914775 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:57:58.915383 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:57:58.921419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:58.921861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:58.922642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:57:58.923108 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:57:59.057100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:57:59.064744 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d3eb4bfa-c2a2-46b1-be42-4cae94778e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.153791 Jun 21 05:57:59.065317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 260/546] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:57:58 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:00.081192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:00.082433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:00.089250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:00.090032 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:00.090581 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:00.090887 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:00.227743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:00.235224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0f56bb64-c795-4d0e-b94f-19358dce6440 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.157831 Jun 21 05:58:00.235784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 287/547] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:00 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:00.666442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:00.667083 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:00.673266 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:00.673715 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:00.674518 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:00.674958 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:00.769899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lazy-loading 'services' on Instance uuid a038cbd5-199a-4273-8ded-1fd9a3528a0e {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:00.857226 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-33ac976f-9512-476a-900f-66c071c757f3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-volume_attachments/76b225e1-bcfb-430a-a506-4dd5e2895297" status: 202 len: 0 microversion: 2.1 time: 0.194155 Jun 21 05:58:00.858864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 261/548] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 05:58:00 2022] DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-volume_attachments/76b225e1-bcfb-430a-a506-4dd5e2895297 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:58:01.252622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:01.253228 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:01.261321 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:01.261763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:01.262587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:01.263008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:01.396321 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:01.404694 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1a31c9f8-c0af-4684-92e9-3df3f7d185d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.156019 Jun 21 05:58:01.405260 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 288/549] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:01 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:01.976478 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3dc6babb-0bea-4c82-893b-83a34c1dd57e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:01.983136 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3dc6babb-0bea-4c82-893b-83a34c1dd57e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:01.983586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3dc6babb-0bea-4c82-893b-83a34c1dd57e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:02.007011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3dc6babb-0bea-4c82-893b-83a34c1dd57e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Going to try to stop instance {{(pid=117430) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 21 05:58:02.012017 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:02.052770 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3dc6babb-0bea-4c82-893b-83a34c1dd57e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.080519 Jun 21 05:58:02.053362 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 262/550] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:58:01 2022] POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:58:02.061759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:02.062458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:02.069435 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:02.069881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:02.070660 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:02.071088 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:02.203936 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:02.208030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:02.213058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-026a18dc-b416-466c-a490-aaa6f57b3d43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.155322 Jun 21 05:58:02.213644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 289/551] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:02 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:02.422926 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:02.423685 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:02.430996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:02.431451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:02.432566 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:02.432683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:02.575388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:02.583063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c9e93189-29f1-4d6f-94f7-3267d556af9c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.164450 Jun 21 05:58:02.583618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 263/552] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:02 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:03.230535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:03.231145 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:03.237563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:03.238037 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:03.238788 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:03.239214 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:03.371425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:03.379649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d7dbff2f-cd3a-46a2-90ef-a5184a9423b7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.152996 Jun 21 05:58:03.380220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 290/553] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:03 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:03.599925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:03.600529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:03.606525 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:03.606980 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:03.607741 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:03.608182 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:03.737057 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:03.745149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3afc49b3-0889-4610-b590-d004483261e4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.149103 Jun 21 05:58:03.745717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 264/554] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:03 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:04.396851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:04.397395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:04.404013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:04.404453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:04.405204 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:04.405633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:04.538614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:04.546246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-57c8d319-f6a9-4565-84ca-d549412213a3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.153176 Jun 21 05:58:04.546703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 291/555] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:04 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:04.761895 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:04.762494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:04.768452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:04.769381 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:04.770171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:04.770598 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:04.904346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:04.913405 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d9c93113-1a9c-4955-8414-d03ddb4f1d8a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.155356 Jun 21 05:58:04.914275 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 265/556] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:04 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:05.564124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:05.564659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:05.571411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:05.571854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:05.572627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:05.573037 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:05.705558 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:05.713898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6847e15c-56eb-415d-8641-57c2094f8633 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.153684 Jun 21 05:58:05.714507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 292/557] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:05 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:05.931429 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:05.932036 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:05.938146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:05.938593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:05.939365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:05.939797 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:06.052016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1297429130", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "networks": [{"uuid": "e61240a9-48fb-49f1-8f20-d7bad2434914"}]}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:06.078767 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:06.086966 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d0f07d15-7e38-4865-a6b6-5dbcfde879c9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.159656 Jun 21 05:58:06.088167 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 266/558] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:05 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:06.104163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] validate_networks() for [('e61240a9-48fb-49f1-8f20-d7bad2434914', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:58:06.458139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:58:06.458650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:58:06.459182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:58:06.459648 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:58:06.460117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:58:06.470270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:06.470729 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:06.471545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-ae8c419d-5bfa-42f8-95f6-92fb970a00fe req-23fc1713-4bcd-490b-ba2b-52fda37b5bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "name": "network-vif-plugged", "status": "completed", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:06.471672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:06.472138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:06.480448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-ae8c419d-5bfa-42f8-95f6-92fb970a00fe req-23fc1713-4bcd-490b-ba2b-52fda37b5bd2 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:06.480965 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-ae8c419d-5bfa-42f8-95f6-92fb970a00fe req-23fc1713-4bcd-490b-ba2b-52fda37b5bd2 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:06.492975 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Getting quotas for project a7e723a47d5246779d7835b9898429e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:58:06.493917 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-ae8c419d-5bfa-42f8-95f6-92fb970a00fe req-23fc1713-4bcd-490b-ba2b-52fda37b5bd2 service nova] Creating event network-vif-plugged:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 05:58:06.498481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Getting quotas for user fc4e3249c43c4e8292475684ce7fd36e and project a7e723a47d5246779d7835b9898429e1. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:58:06.499195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-ae8c419d-5bfa-42f8-95f6-92fb970a00fe req-23fc1713-4bcd-490b-ba2b-52fda37b5bd2 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Jun 21 05:58:06.500227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 267/559] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:58:06.513120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:58:06.516027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:58:06.571663 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c9c5ee0e-84a2-49d2-a99b-d402c5cae95c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523400 Jun 21 05:58:06.572478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 293/560] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:58:06.583521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4495b175-2e02-45ab-ac9f-ed8b81b46f06 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:06.584277 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4495b175-2e02-45ab-ac9f-ed8b81b46f06 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:06.638788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4495b175-2e02-45ab-ac9f-ed8b81b46f06 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:06.646456 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4495b175-2e02-45ab-ac9f-ed8b81b46f06 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1219 microversion: 2.1 time: 0.067598 Jun 21 05:58:06.647361 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 268/561] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:06 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:06.732208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:06.732921 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:06.740699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:06.741151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:06.742025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:06.742493 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:06.896078 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:06.903918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d335d7fc-29ea-4bb6-8928-1d71381b5aa7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.176077 Jun 21 05:58:06.904488 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 294/562] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:06 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:07.104916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:07.105453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:07.113371 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:07.114008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:07.114813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:07.115250 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:07.257524 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:07.265334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-47540d3c-5993-48f4-91a3-e5e1d701091a tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.164393 Jun 21 05:58:07.265899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 269/563] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:07 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:07.664200 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:07.664803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:07.671267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:07.671703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:07.672591 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:07.673015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:07.734902 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:07.742376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-83c5a0d9-7980-4288-afa5-992bebc7622c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1271 microversion: 2.1 time: 0.082904 Jun 21 05:58:07.742947 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 295/564] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:07 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:07.920497 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:07.921104 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:07.927179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:07.927623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:07.928387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:07.928823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:08.057522 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:08.064895 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-89c02cb8-892a-43e1-8d96-c8ea01c5c75b tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.148285 Jun 21 05:58:08.065450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 270/565] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:07 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:08.281312 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:08.282134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:08.289331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:08.289850 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:08.291194 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:08.291296 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:08.432572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:08.440959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5f87e528-69fa-4668-9885-0b5c450e2e58 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1259 microversion: 2.1 time: 0.163517 Jun 21 05:58:08.441538 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 296/566] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:08 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:08.759792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:08.760479 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:08.767088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:08.767529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:08.768290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:08.768740 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:08.907527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:08.915516 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-edde5c7c-a7c9-444c-9d47-b44d4bf8af6c tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.159687 Jun 21 05:58:08.916221 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 271/567] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:08 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:09.084394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:09.084394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:09.091371 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.092086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.093106 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.093601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.229981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:09.237742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a1170750-a727-427a-92cc-c1d6fd385c08 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.159105 Jun 21 05:58:09.238320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 297/568] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:09 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:09.457441 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:09.458067 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:09.464959 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.465389 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.466188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.466611 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.620407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:09.629016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5801e4f4-ca28-46f8-996c-9d8c01dfc8a4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1442 microversion: 2.1 time: 0.175489 Jun 21 05:58:09.629606 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 272/569] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:09 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:09.646471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:09.647114 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:09.653960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.654417 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.655201 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.655631 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.804634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:09.813135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6d33ca2b-6710-41a9-86b7-3261b42225b4 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1442 microversion: 2.1 time: 0.171268 Jun 21 05:58:09.813729 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 298/570] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:09 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1442 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:09.933275 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:09.934822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:09.938659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-9fa0b6ce-548f-4768-911d-8be5e32b53b7 req-2b401c74-a9b0-40c1-b123-53bf2c1e2e38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706f5ab3-32ff-496c-8980-cf961e9b66a5", "tag": "1cb2f419-9312-4b83-a131-797f832ce6c8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:09.943946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.945026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.946160 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.947656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.950029 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-9fa0b6ce-548f-4768-911d-8be5e32b53b7 req-2b401c74-a9b0-40c1-b123-53bf2c1e2e38 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:09.951046 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-9fa0b6ce-548f-4768-911d-8be5e32b53b7 req-2b401c74-a9b0-40c1-b123-53bf2c1e2e38 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:09.980725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-9fa0b6ce-548f-4768-911d-8be5e32b53b7 req-2b401c74-a9b0-40c1-b123-53bf2c1e2e38 service nova] Creating event network-changed:1cb2f419-9312-4b83-a131-797f832ce6c8 for instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 on hv-cinder-84690 Jun 21 05:58:09.986064 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-9fa0b6ce-548f-4768-911d-8be5e32b53b7 req-2b401c74-a9b0-40c1-b123-53bf2c1e2e38 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051390 Jun 21 05:58:09.987365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 299/571] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:10.195507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:10.204621 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-45ca5513-2a02-48a8-864f-e64fc7f11206 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.275817 Jun 21 05:58:10.205201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 273/572] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:09 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:10.255572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:10.256986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:10.264017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:10.264454 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:10.265210 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:10.265806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:10.471325 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:10.479695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-22923ac7-f447-40f6-b730-d7c3fb3c8c69 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.228465 Jun 21 05:58:10.480379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 300/573] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:10 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:11.221418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:11.222616 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:11.228825 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:11.229277 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:11.230083 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:11.230517 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:11.499516 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:11.500085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:11.507966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:11.508412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:11.509201 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:11.509636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:11.792686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:11.801504 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6218ffb8-ec0b-4f27-9375-b9e75963fc3b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.584122 Jun 21 05:58:11.806467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 274/574] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:11 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:11.807503 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:11.816725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-18ffb05a-e805-406e-8d2f-f194eb711ee0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.322465 Jun 21 05:58:11.817635 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 301/575] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:11 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:12.102087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-8c1d95de-51b5-4d64-92b5-129eeaa18340 req-0e67bcba-1d18-4338-b52c-050ae92c64a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:12.113317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-8c1d95de-51b5-4d64-92b5-129eeaa18340 req-0e67bcba-1d18-4338-b52c-050ae92c64a9 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:12.113764 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-8c1d95de-51b5-4d64-92b5-129eeaa18340 req-0e67bcba-1d18-4338-b52c-050ae92c64a9 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:12.126068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-8c1d95de-51b5-4d64-92b5-129eeaa18340 req-0e67bcba-1d18-4338-b52c-050ae92c64a9 service nova] Creating event network-changed:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 05:58:12.131706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-8c1d95de-51b5-4d64-92b5-129eeaa18340 req-0e67bcba-1d18-4338-b52c-050ae92c64a9 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033283 Jun 21 05:58:12.132687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 275/576] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:12.821551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:12.822202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:12.835304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:12.836019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:12.839759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:12.840302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:12.841116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:12.841553 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:12.849845 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:12.850345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:12.851232 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:12.851741 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.055675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:13.063605 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cf88cdf4-c89f-4540-9690-af4a735f6ab3 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.232424 Jun 21 05:58:13.063825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:13.064174 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 276/577] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:12 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:13.073601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f02f3e7f-eb21-4c75-ad76-47cf091f395e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.254814 Jun 21 05:58:13.073601 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 302/578] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:12 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:13.689574 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:13.690103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:13.696253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.696698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.697459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.697896 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.722593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7df8d56e-085c-4528-9e4d-0cd5a8d77119 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/ips" status: 200 len: 149 microversion: 2.1 time: 0.036022 Jun 21 05:58:13.723182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 303/579] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 05:58:13 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:13.733770 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "371419f4-5ca9-4046-9c7d-f87c77e1d368"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:13.734930 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:13.740840 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.741278 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.742065 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.742494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.821512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Invalid volume: volume 371419f4-5ca9-4046-9c7d-f87c77e1d368 is already attached to instances: 598a1303-6c97-4b4d-832a-81f96b131503 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: POST /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/os-volume_attachments HTTP/1.1 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 74 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:58:13.823253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {"volumeAttachment": {"volumeId": "371419f4-5ca9-4046-9c7d-f87c77e1d368"}} Jun 21 05:58:13.824688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Invalid volume: volume 371419f4-5ca9-4046-9c7d-f87c77e1d368 is already attached to instances: 598a1303-6c97-4b4d-832a-81f96b131503 Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'server_id': '64a1f275-13ca-4db4-8350-f3b2b5ab7c15', 'body': {'volumeAttachment': {'volumeId': '371419f4-5ca9-4046-9c7d-f87c77e1d368'}}} Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 371419f4-5ca9-4046-9c7d-f87c77e1d368 is already attached to instances: 598a1303-6c97-4b4d-832a-81f96b131503 Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:58:13.825622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 371419f4-5ca9-4046-9c7d-f87c77e1d368 is already attached to instances: 598a1303-6c97-4b4d-832a-81f96b131503 Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:13.827005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 371419f4-5ca9-4046-9c7d-f87c77e1d368 is already attached to instances: 598a1303-6c97-4b4d-832a-81f96b131503 Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 400 to user: Invalid volume: volume 371419f4-5ca9-4046-9c7d-f87c77e1d368 is already attached to instances: 598a1303-6c97-4b4d-832a-81f96b131503 {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8f360d0c-4aa5-48e6-b145-1a636d23d562 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094955 Jun 21 05:58:13.828446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 277/580] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:58:13 2022] POST /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 05:58:13.834211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:13.834717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:13.841390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.841837 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.842686 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.843123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.869451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:58:13.948768 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-27d6ba45-cd04-4c85-b0f5-cc317ad1fa02 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 204 len: 0 microversion: 2.1 time: 0.118576 Jun 21 05:58:13.949341 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 304/581] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:58:13 2022] DELETE /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 21 05:58:13.957974 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:13.958585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:13.965535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.966018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:13.966803 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:13.967240 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:14.082454 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:14.083174 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:14.090461 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:14.090916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:14.091708 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:14.092146 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:14.102263 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:14.117474 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-62773075-5f07-4c71-a6cd-3bacfbc7d87c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1679 microversion: 2.1 time: 0.163719 Jun 21 05:58:14.118169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 278/582] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:13 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:14.123102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:14.123715 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:14.130925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:14.131369 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:14.132145 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:14.132583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:14.294804 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:14.302276 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d832f1f9-877f-44a4-9fba-96c6af330ec9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.225230 Jun 21 05:58:14.303088 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 305/583] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:14 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:14.323572 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:14.331864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f9026fdd-5a13-477e-ba69-e49cf5f38366 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.212112 Jun 21 05:58:14.332576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 279/584] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:14 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:15.134911 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:15.135511 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:15.137944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:15.144696 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:15.145136 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:15.145912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:15.146367 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:15.167616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:15.285088 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:15.292554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-866393fa-2536-4fe0-8333-34458ef99ff3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1679 microversion: 2.1 time: 0.161471 Jun 21 05:58:15.293119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 306/585] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:15 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:15.319019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:15.319754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:15.325824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:15.326308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:15.327072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:15.327500 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:15.349330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:15.349967 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:15.355874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:15.356317 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:15.357069 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:15.357500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:15.536764 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:15.539239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:15.540070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:15.546032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f9b8ec5d-ce63-4d27-9739-69fb332727ca tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.230757 Jun 21 05:58:15.546618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 280/586] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:15 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:15.548034 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dcb9f832-9e01-423e-9f38-341ced45860f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.203059 Jun 21 05:58:15.548587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 307/587] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:15 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:16.309356 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:16.310002 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:16.318184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.318634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.319463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.320022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.470130 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:16.478810 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5d410d55-32d3-45da-9c7b-123cf28f896d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1679 microversion: 2.1 time: 0.173396 Jun 21 05:58:16.479963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 281/588] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:16 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:16.528421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-f2f8b78a-e235-4538-a096-2c7cd868b518 req-f0416e24-280d-4bed-8e13-ac0b23b1832a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706f5ab3-32ff-496c-8980-cf961e9b66a5", "name": "network-vif-plugged", "status": "completed", "tag": "1cb2f419-9312-4b83-a131-797f832ce6c8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:16.532614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:16.533300 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=6 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:16.543552 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-f2f8b78a-e235-4538-a096-2c7cd868b518 req-f0416e24-280d-4bed-8e13-ac0b23b1832a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.544375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-f2f8b78a-e235-4538-a096-2c7cd868b518 req-f0416e24-280d-4bed-8e13-ac0b23b1832a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.556449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-f2f8b78a-e235-4538-a096-2c7cd868b518 req-f0416e24-280d-4bed-8e13-ac0b23b1832a service nova] Creating event network-vif-plugged:1cb2f419-9312-4b83-a131-797f832ce6c8 for instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 on hv-cinder-84690 Jun 21 05:58:16.563428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:16.564034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:16.571260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.571717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.574816 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-f2f8b78a-e235-4538-a096-2c7cd868b518 req-f0416e24-280d-4bed-8e13-ac0b23b1832a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050120 Jun 21 05:58:16.575586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 308/589] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:16.578965 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.579618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.588035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:16.588976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:16.609762 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.611058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.611394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:16.611832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:16.642937 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:16.816938 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:16.824565 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:16.825725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bece6251-8e7d-45b7-bd50-96f05624cf17 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.266334 Jun 21 05:58:16.826345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 282/590] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:16 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:16.833762 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a9f31557-e078-4462-9d8d-948dbe75d73e tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.257014 Jun 21 05:58:16.834508 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 309/591] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:16 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:17.159202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-b01deab7-abce-49fc-bb64-6482cdd89922 req-aae2909a-74d7-457e-a9ba-7c43a006c8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a1f275-13ca-4db4-8350-f3b2b5ab7c15", "name": "network-vif-deleted", "tag": "5b93abaa-a3c8-4631-85ba-8cadb9fe7757"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:17.167617 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-b01deab7-abce-49fc-bb64-6482cdd89922 req-aae2909a-74d7-457e-a9ba-7c43a006c8e1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.168055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-b01deab7-abce-49fc-bb64-6482cdd89922 req-aae2909a-74d7-457e-a9ba-7c43a006c8e1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.179549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-b01deab7-abce-49fc-bb64-6482cdd89922 req-aae2909a-74d7-457e-a9ba-7c43a006c8e1 service nova] Creating event network-vif-deleted:5b93abaa-a3c8-4631-85ba-8cadb9fe7757 for instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 on hv-cinder-84690 Jun 21 05:58:17.184439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-b01deab7-abce-49fc-bb64-6482cdd89922 req-aae2909a-74d7-457e-a9ba-7c43a006c8e1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028848 Jun 21 05:58:17.185030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 283/592] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:17.498322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:17.499118 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:17.506058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.506587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.507365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.507789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.541070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.541764 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.541971 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'fault' on Instance uuid 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:17.593653 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:17.602641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fd32fdbf-6891-4837-b153-39f51884a6e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1330 microversion: 2.1 time: 0.108129 Jun 21 05:58:17.603458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 310/593] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:17 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:17.843848 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:17.845558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:17.851532 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:17.852675 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:17.861176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.866118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.866564 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.867419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.867737 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.869664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:17.870496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:17.870926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:18.086915 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:18.095588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bab6ed5c-0e3a-49f1-a44f-51a2ce846a55 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1678 microversion: 2.1 time: 0.255845 Jun 21 05:58:18.104229 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 284/594] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:17 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1678 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:18.121632 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:18.132299 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ee02ab43-98cf-4567-a965-fa2de591db37 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1319 microversion: 2.1 time: 0.284199 Jun 21 05:58:18.133282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 311/595] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:17 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:18.620379 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:18.620989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:18.623080 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:18.629434 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:18.629882 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:18.630689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:18.631120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:18.666348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:18.666711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:18.667171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'fault' on Instance uuid 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:18.714730 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:18.722934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a93d9436-f64a-45ee-b59f-42ccd0539fe7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 200 len: 1330 microversion: 2.1 time: 0.106503 Jun 21 05:58:18.723658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 285/596] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:18 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:19.113407 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:19.114333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:19.121740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.122278 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.124459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.124922 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.149230 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:19.150023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:19.163159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.163622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.164410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.164841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.317290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:19.325667 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9185367c-1594-4548-950f-1fa7bdfe35c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1655 microversion: 2.1 time: 0.216831 Jun 21 05:58:19.326275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 312/597] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:19 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1655 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:19.340175 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:19.341702 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e473c3d1-b7f8-46c0-bf12-0ffac1ebf7a8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:19.348795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d7d32096-0e11-45d9-a2b7-746fd56ceb4f tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1508 microversion: 2.1 time: 0.203343 Jun 21 05:58:19.348980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e473c3d1-b7f8-46c0-bf12-0ffac1ebf7a8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.349162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e473c3d1-b7f8-46c0-bf12-0ffac1ebf7a8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.352998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 286/598] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:19 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:19.365634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "913b6401-bc64-4666-bbdf-6a96308ff910", "device": "/dev/sdb"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:19.367279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:19.371670 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e473c3d1-b7f8-46c0-bf12-0ffac1ebf7a8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Going to try to start instance {{(pid=117431) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 21 05:58:19.373120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.373558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.374457 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.374769 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.415103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e473c3d1-b7f8-46c0-bf12-0ffac1ebf7a8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.076947 Jun 21 05:58:19.415777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 313/599] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:58:19 2022] POST /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 05:58:19.424140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:19.425667 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:19.432444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.432918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.433847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.434375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.586470 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:19.595512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b62dcdc3-2a78-41c3-878b-5d8841e18198 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1664 microversion: 2.1 time: 0.175368 Jun 21 05:58:19.596237 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 314/600] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:19 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:19.670654 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0684a843-8057-4116-bb04-52017c242c90 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "POST /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309129 Jun 21 05:58:19.671384 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 287/601] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:58:19 2022] POST /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:19.738949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:19.739597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:19.745915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.746511 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.747382 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:19.748507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:19.765674 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 HTTP/1.1 Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:58:19.767547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 05:58:19.769588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '64a1f275-13ca-4db4-8350-f3b2b5ab7c15'} Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:58:19.770438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 05:58:19.771592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:19.772657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:58:19.772657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-705538a5-e890-4bde-b554-df82bb57e0af tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 404 len: 111 microversion: 2.1 time: 0.034655 Jun 21 05:58:19.772657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 315/602] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:19 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:58:19.779095 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d2fc5d11-85c2-475c-81a1-dfd2a6efdff1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '.version_select at 0x7efe5c826a60>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:19.799483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d2fc5d11-85c2-475c-81a1-dfd2a6efdff1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-151672078" status: 202 len: 0 microversion: 2.1 time: 0.024410 Jun 21 05:58:19.800155 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 288/603] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Jun 21 05:58:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-151672078 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 05:58:20.572705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:20.573206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:20.580016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:20.580460 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:20.581204 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:20.581636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:20.614635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:20.615357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:20.622221 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:20.622674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:20.623469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:20.623929 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:20.706408 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'services' on Instance uuid 598a1303-6c97-4b4d-832a-81f96b131503 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:20.761600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:20.770981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-993caeff-9124-469b-87e9-52518f0df770 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1664 microversion: 2.1 time: 0.161251 Jun 21 05:58:20.772844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 289/604] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:20 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:20.823034 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-45e8f68e-ebdb-42b9-afda-718bcae58608 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments/371419f4-5ca9-4046-9c7d-f87c77e1d368" status: 202 len: 0 microversion: 2.1 time: 0.254094 Jun 21 05:58:20.823625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 316/605] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 05:58:20 2022] DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments/371419f4-5ca9-4046-9c7d-f87c77e1d368 => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:58:20.831968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:20.832936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:20.839165 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:20.839610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:20.840608 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:20.841120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:20.874264 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-43b1ae81-8b27-4657-88cf-3a5d83ac6285 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046094 Jun 21 05:58:20.875007 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 290/606] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:20 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:21.789961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:21.790602 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:21.797331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:21.797771 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:21.798962 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:21.799058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:21.887543 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:21.888553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:21.895936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:21.896375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:21.897152 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:21.897594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:21.929281 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-231b9ad3-3255-46a8-afd9-ddcf7385d376 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Jun 21 05:58:21.929840 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 291/607] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:21 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:21.936790 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:21.944684 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f9eaf933-d90a-47b5-8296-8120f85a1db4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1668 microversion: 2.1 time: 0.158945 Jun 21 05:58:21.945338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 317/608] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:21 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:22.940892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:22.941830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:22.948423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:22.948861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:22.949609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:22.950070 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:22.979583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-733e09df-9a57-40c6-a68f-70e9eebed6ac tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Jun 21 05:58:22.980136 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 292/609] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:22 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:23.552804 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8628e2ea-831f-4a45-b2f0-5bbbab2d588b"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:23.553944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:23.560569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:23.561013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:23.561798 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:23.562240 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:23.802649 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-64035bfe-15c5-4d1b-b59e-4919214beab3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253769 Jun 21 05:58:23.803291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 318/610] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:58:23 2022] POST /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:23.992039 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:23.992884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:23.999936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:24.000378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:24.001145 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:24.001580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:24.032999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4cc8dc88-ec61-4b69-9aa3-79407f2c9c26 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Jun 21 05:58:24.034119 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 293/611] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:23 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:25.046302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:25.047347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:25.054769 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:25.055221 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:25.055991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:25.056416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:25.086954 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-675a173f-99db-41f7-9c15-b9b1939bb579 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045441 Jun 21 05:58:25.087529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 319/612] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:25 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:26.099221 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:26.100137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:26.106930 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:26.107375 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:26.108147 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:26.108580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:26.137804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-333a474b-13e7-44eb-9d0a-ff59b93c3857 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Jun 21 05:58:26.138385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 294/613] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:26 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:27.149778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:27.151110 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:27.158975 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:27.159420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:27.160175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:27.160621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:27.192871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-506e861c-7b5f-4f25-a58d-6045c9539560 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Jun 21 05:58:27.193644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 320/614] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:27 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:58:28.204877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:28.206354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:28.213133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:28.213585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:28.214414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:28.214891 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:28.244665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1ecdc7be-3a46-4775-9ff5-93bea552caba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043908 Jun 21 05:58:28.245269 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 295/615] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:58:28 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 05:58:28.303339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:28.303910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:28.310377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:28.310827 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:28.311590 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:28.312027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:28.316205 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:28.339471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:58:28.418797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-25529bab-97b2-4fb3-803b-64d107271e8e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 204 len: 0 microversion: 2.1 time: 0.119236 Jun 21 05:58:28.419387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 321/616] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:58:28 2022] DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:58:28.428315 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:28.428916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:28.435353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:28.435945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:28.436768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:28.437177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:28.571994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:28.580727 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-696348e7-7c6a-4c63-a4ff-ef607bacb16a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.156257 Jun 21 05:58:28.581306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 296/617] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:28 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:29.599374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:29.599986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:29.606398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:29.606834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:29.607575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:29.608000 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:29.737779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:29.745382 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6effe815-f441-4e2b-aeee-bccd2ecc5a44 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.150862 Jun 21 05:58:29.745951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 322/618] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:29 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:30.763117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:30.763787 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:30.770516 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:30.770962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:30.771721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:30.772153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:30.788004 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:30.911771 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:30.919442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-97518481-283c-4578-9b43-925e1687cf1e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.160409 Jun 21 05:58:30.920009 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 297/619] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:30 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:31.937085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:31.937682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:31.945332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:31.945766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:31.946550 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:31.946975 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:32.082788 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:32.097076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-382add9e-f2c4-4d8c-b1b6-6ddb3f9b9bdc tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.162997 Jun 21 05:58:32.103479 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 323/620] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:31 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:33.116284 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:33.117353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:33.124711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:33.125152 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:33.125911 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:33.126382 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:33.258149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:33.269656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ba69483d-4237-4fb7-a5ce-a29f8fcb22e7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.159607 Jun 21 05:58:33.270261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 298/621] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:33 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:34.287979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:34.288530 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:34.295052 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:34.295495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:34.296247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:34.296676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:34.430307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:34.437835 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-af0085bc-c8f4-467e-b6c8-1fb641f6b35b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.153769 Jun 21 05:58:34.438438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 324/622] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:34 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:35.455519 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:35.456211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:35.463214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:35.463774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:35.464613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:35.465108 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:35.603069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:35.610953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-27f55d99-78c7-4b8c-84d4-70d88fd8c300 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1682 microversion: 2.1 time: 0.159802 Jun 21 05:58:35.611544 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 299/623] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:35 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:36.161139 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-6cfd9e89-bc62-4af3-bad6-371c8d4cabd0 req-974935b8-3242-44e4-8a31-713ae324a773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598a1303-6c97-4b4d-832a-81f96b131503", "name": "network-vif-deleted", "tag": "6a306a06-4c23-4c15-b5bb-522ebc76e824"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:36.169700 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6cfd9e89-bc62-4af3-bad6-371c8d4cabd0 req-974935b8-3242-44e4-8a31-713ae324a773 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:36.170175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6cfd9e89-bc62-4af3-bad6-371c8d4cabd0 req-974935b8-3242-44e4-8a31-713ae324a773 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:36.184003 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-6cfd9e89-bc62-4af3-bad6-371c8d4cabd0 req-974935b8-3242-44e4-8a31-713ae324a773 service nova] Creating event network-vif-deleted:6a306a06-4c23-4c15-b5bb-522ebc76e824 for instance 598a1303-6c97-4b4d-832a-81f96b131503 on hv-cinder-84690 Jun 21 05:58:36.190377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-6cfd9e89-bc62-4af3-bad6-371c8d4cabd0 req-974935b8-3242-44e4-8a31-713ae324a773 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032320 Jun 21 05:58:36.190915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 325/624] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:36.629701 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:36.630695 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:36.637447 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:36.637861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:36.638668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:36.639098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:36.674283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:36.675051 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:36.675521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'fault' on Instance uuid 598a1303-6c97-4b4d-832a-81f96b131503 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:36.716922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:36.725285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-12b590d8-8512-4669-926c-a163f2c43185 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 200 len: 1332 microversion: 2.1 time: 0.100371 Jun 21 05:58:36.725869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 300/625] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:36 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:37.744032 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:37.744633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:37.750758 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:37.751195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:37.752544 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:37.752964 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:37.766315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 HTTP/1.1 Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:58:37.767959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 05:58:37.769510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '598a1303-6c97-4b4d-832a-81f96b131503'} Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:58:37.770499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 05:58:37.771743 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:37.772910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:58:37.772910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-10596204-e641-47f2-84a0-a1bc1ee50b67 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 404 len: 111 microversion: 2.1 time: 0.030104 Jun 21 05:58:37.772910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 326/626] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:37 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:58:37.778100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-593dcc6c-7d9c-4712-9749-0ad84728797f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '.version_select at 0x7efe5cb258b0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:37.795371 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-593dcc6c-7d9c-4712-9749-0ad84728797f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126116869" status: 202 len: 0 microversion: 2.1 time: 0.021067 Jun 21 05:58:37.795934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 301/627] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 21 05:58:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126116869 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:58:38.448016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d2cf49b7-33d3-433d-af87-1da27064fa79 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: .version_select at 0x7efe5c7e63a0>, body: {"keypair": {"name": "tempest-keypair-752369924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMKxwEEcmemTff5PCcjJRXBYzIDxtLGLrnqPPzYywa97U7OzkTzmCiBjd1UKzo29T/1Um/4kJs7DUtTfzHn7w777I4Uzgb/M0I6ELhG/h9Tc3/niJmqKMnbfCmmsSdfYw=="}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:38.462527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-d2cf49b7-33d3-433d-af87-1da27064fa79 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:58:38.466307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-d2cf49b7-33d3-433d-af87-1da27064fa79 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:58:38.488796 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d2cf49b7-33d3-433d-af87-1da27064fa79 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044566 Jun 21 05:58:38.489390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 327/628] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:58:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:39.063640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:39.064283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:39.071212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:39.071661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:39.072440 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:39.072938 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:39.163536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lazy-loading 'services' on Instance uuid 706f5ab3-32ff-496c-8980-cf961e9b66a5 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:39.248401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-487eed6f-b828-45ea-b9b9-994057fa071b tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5/os-volume_attachments/913b6401-bc64-4666-bbdf-6a96308ff910" status: 202 len: 0 microversion: 2.1 time: 0.189305 Jun 21 05:58:39.249081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 302/629] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 05:58:39 2022] DELETE /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5/os-volume_attachments/913b6401-bc64-4666-bbdf-6a96308ff910 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:58:39.852700 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2137025306", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af2e04db-de33-4272-99f0-75327f84c194"}], "security_groups": [{"name": "tempest-securitygroup--1022285264"}], "key_name": "tempest-keypair-752369924", "user_data": "}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:39.954448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] validate_networks() for [('af2e04db-de33-4272-99f0-75327f84c194', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:58:40.329464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:58:40.330034 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:58:40.330421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:58:40.330848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:58:40.331234 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:58:40.340678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:40.341151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:40.341946 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:40.342394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:40.360512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:58:40.365236 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:58:40.376360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:58:40.378643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:58:40.426246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bf476247-358b-4c6c-a104-a2f62954cda7 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.578595 Jun 21 05:58:40.427083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 328/630] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:58:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:58:40.437841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4b702ff3-2755-4554-9a46-ee5faa9a0dd1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:40.438722 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4b702ff3-2755-4554-9a46-ee5faa9a0dd1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:40.497563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4b702ff3-2755-4554-9a46-ee5faa9a0dd1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:40.504452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4b702ff3-2755-4554-9a46-ee5faa9a0dd1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1241 microversion: 2.1 time: 0.071285 Jun 21 05:58:40.505024 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 303/631] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:40 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:41.522037 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:41.522763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:41.531224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:41.531717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:41.532530 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:41.532966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:41.597799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:41.605219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4c9d9fd9-8872-4478-86e0-8b9cb208b57a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1293 microversion: 2.1 time: 0.088368 Jun 21 05:58:41.605778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 329/632] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:41 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:41.863806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:41.864782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:41.872393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:41.872851 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:41.873619 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:41.874079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:41.899409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'flavor' on Instance uuid 84283f84-8793-4072-8e32-bfec2d2035f2 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:42.039047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-51d83836-0c1c-483d-8fbd-fd8001a7cb88 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/action" status: 200 len: 32 microversion: 2.1 time: 0.180555 Jun 21 05:58:42.039638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 304/633] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:58:41 2022] POST /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/action => generated 32 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 05:58:42.049842 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:42.050583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:42.057096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.057922 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.058940 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.059424 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.195327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:42.203685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-43937d17-5eef-48c7-9889-0451e0e0fdd3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.158802 Jun 21 05:58:42.204793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 330/634] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:42 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:42.480302 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:42.480905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:42.490962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.491417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.492201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.492659 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.519422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:58:42.601421 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-874fae9d-18b8-4aab-9cfe-8131d1c73108 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "DELETE /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 204 len: 0 microversion: 2.1 time: 0.124960 Jun 21 05:58:42.602129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 305/635] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:58:42 2022] DELETE /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:58:42.610839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:42.611352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:42.621052 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.621586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.622631 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.622990 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:42.623413 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.623857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:42.630753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.631295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.632671 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:42.632671 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:42.722497 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:42.731253 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7f407818-b0b8-4b41-a340-70d54f22f621 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1299 microversion: 2.1 time: 0.112521 Jun 21 05:58:42.732076 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 306/636] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:42 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:42.788275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:42.795756 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e77cda90-6421-4124-bc8a-d74df4709edc tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1514 microversion: 2.1 time: 0.189256 Jun 21 05:58:42.796324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 331/637] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:42 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:43.220834 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:43.221441 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:43.228099 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:43.228550 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:43.229357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:43.229794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:43.361103 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:43.369163 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ed38d6e1-6d59-49e0-b77c-6193360f6828 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.152448 Jun 21 05:58:43.369736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 307/638] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:43 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:43.748542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:43.749149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:43.755779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:43.756222 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:43.756984 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:43.757415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:43.812545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:43.813265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:43.819446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:43.819965 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:43.820795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:43.821297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:43.935245 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:43.943485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-18827922-2288-46a8-b8da-aae5bd5751aa tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.198672 Jun 21 05:58:43.944657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 332/639] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:43 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:43.979289 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:43.987323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1c386ff6-a5d9-4e1b-bfcc-cdfba70934e3 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1514 microversion: 2.1 time: 0.178755 Jun 21 05:58:43.987876 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 308/640] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:43 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:44.386801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:44.387542 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:44.394173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:44.394696 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:44.395522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:44.395958 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:44.798686 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:44.806855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8001028a-7b24-47ae-aff3-7ab2947302de tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.423805 Jun 21 05:58:44.807433 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 333/641] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:44 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:44.960889 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:44.962261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:44.969858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:44.970357 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:44.971160 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:44.971589 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.008982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:45.009643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:45.017965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:45.018419 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.019197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:45.019637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.358182 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:45.365394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:45.370326 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-de85aab1-6c6d-4ffa-bd86-544c9fc40ccd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.413178 Jun 21 05:58:45.371631 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 309/642] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:44 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:45.375820 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-352d44fa-a8a8-4b46-a7cd-b9c77e025a01 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1514 microversion: 2.1 time: 0.375206 Jun 21 05:58:45.376450 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 334/643] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:44 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1514 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:45.377058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-948a6a5b-30d4-47d0-aed0-80f0a246d868 req-e90b25dc-882e-44f8-b222-f9c4357ed9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a169ff-6c9d-4d88-885a-cb082c72980c", "tag": "43fda2d1-d511-44e5-aad7-2e6b22b30b19"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:45.387451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-948a6a5b-30d4-47d0-aed0-80f0a246d868 req-e90b25dc-882e-44f8-b222-f9c4357ed9d1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:45.387885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-948a6a5b-30d4-47d0-aed0-80f0a246d868 req-e90b25dc-882e-44f8-b222-f9c4357ed9d1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.400111 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-948a6a5b-30d4-47d0-aed0-80f0a246d868 req-e90b25dc-882e-44f8-b222-f9c4357ed9d1 service nova] Creating event network-changed:43fda2d1-d511-44e5-aad7-2e6b22b30b19 for instance 24a169ff-6c9d-4d88-885a-cb082c72980c on hv-cinder-84690 Jun 21 05:58:45.404950 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-948a6a5b-30d4-47d0-aed0-80f0a246d868 req-e90b25dc-882e-44f8-b222-f9c4357ed9d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031993 Jun 21 05:58:45.405548 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 310/644] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:45.576099 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-2afcd6fb-8c55-434a-a0f6-15d90bedb88c req-3a32e612-ba51-4396-8ed2-747bdf246b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706f5ab3-32ff-496c-8980-cf961e9b66a5", "name": "network-vif-deleted", "tag": "1cb2f419-9312-4b83-a131-797f832ce6c8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:45.580240 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:45.589630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-2afcd6fb-8c55-434a-a0f6-15d90bedb88c req-3a32e612-ba51-4396-8ed2-747bdf246b6f service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:45.590150 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-2afcd6fb-8c55-434a-a0f6-15d90bedb88c req-3a32e612-ba51-4396-8ed2-747bdf246b6f service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.609638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-2afcd6fb-8c55-434a-a0f6-15d90bedb88c req-3a32e612-ba51-4396-8ed2-747bdf246b6f service nova] Creating event network-vif-deleted:1cb2f419-9312-4b83-a131-797f832ce6c8 for instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 on hv-cinder-84690 Jun 21 05:58:45.616944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-2afcd6fb-8c55-434a-a0f6-15d90bedb88c req-3a32e612-ba51-4396-8ed2-747bdf246b6f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044598 Jun 21 05:58:45.617551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 335/645] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:58:45.825244 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:45.825841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:45.832562 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:45.833000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.833768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:45.834198 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:45.972452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:45.980815 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7f0645a1-1010-4127-aaea-9620eb7b88ed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.159780 Jun 21 05:58:45.981393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 311/646] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:45 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:46.387744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:46.388355 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:46.395373 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:46.395857 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:46.396657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:46.397090 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:46.398643 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:46.399252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:46.405283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:46.405736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:46.406537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:46.406998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:46.410330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:46.441752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:46.442235 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:46.442691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lazy-loading 'fault' on Instance uuid 706f5ab3-32ff-496c-8980-cf961e9b66a5 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:46.495075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc4e3249c43c4e8292475684ce7fd36e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7e723a47d5246779d7835b9898429e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:46.503169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bf561191-88df-40fe-b2b3-a3e741903648 tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 200 len: 1309 microversion: 2.1 time: 0.108478 Jun 21 05:58:46.503742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 312/647] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:46 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:46.558976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:46.566547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1cb2d3b7-363d-4453-90a1-20c1a0602092 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.183037 Jun 21 05:58:46.567115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 336/648] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:46 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:46.999739 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:47.001471 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:47.009626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:47.010109 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:47.010921 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:47.011355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:47.158313 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:47.167186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b40f8416-9d43-4db8-ada3-42ebea3a19e6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.172356 Jun 21 05:58:47.167709 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 313/649] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:46 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:47.520730 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:47.521348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] [instance: 706f5ab3-32ff-496c-8980-cf961e9b66a5] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:47.527982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:47.528428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:47.529194 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:47.529637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:47.544091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] HTTP exception thrown: Instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 could not be found. Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Request method failure captured: Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 HTTP/1.1 Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV2VhRHeMkjVydmD8S-0OmbXeOqZPMCfBaBVQ6XPCgNicxU_jL2NMXRWrlzUVz3bUCw-c4ExuZW1L5n6nTYqV2qkIoxgzYQfGK5KJ0bO7Z6pLGq34WKwF0iJk5Bb7lJcjrqgBi-I0Id8DuWLS0PrqU-XDNM4LwhRsRIs62nAm_vEjHg Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: a7e723a47d5246779d7835b9898429e1 Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1527295436 Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:58:47.545761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7e723a47d5246779d7835b9898429e1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/a7e723a47d5246779d7835b9898429e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_a7e723a47d5246779d7835b9898429e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/a7e723a47d5246779d7835b9898429e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesSnapshotTestJSON-1527295436 Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: a7e723a47d5246779d7835b9898429e1 Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1527295436 Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesSnapshotTestJSON-1527295436-project Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: fc4e3249c43c4e8292475684ce7fd36e Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesSnapshotTestJSON-1527295436-project Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 could not be found. Jun 21 05:58:47.547288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '706f5ab3-32ff-496c-8980-cf961e9b66a5'} Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 could not be found. Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:58:47.548100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 could not be found. Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 could not be found. Jun 21 05:58:47.549332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:58:47.550495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] Returning 404 to user: Instance 706f5ab3-32ff-496c-8980-cf961e9b66a5 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:58:47.550495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1235221b-e2be-4326-99bf-974f57c791cb tempest-VolumesSnapshotTestJSON-1527295436 tempest-VolumesSnapshotTestJSON-1527295436-project] 10.222.0.18 "GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5" status: 404 len: 111 microversion: 2.1 time: 0.030936 Jun 21 05:58:47.550495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 337/650] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:47 2022] GET /compute/v2.1/servers/706f5ab3-32ff-496c-8980-cf961e9b66a5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:58:47.583852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:47.584453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:47.590653 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:47.591104 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:47.591875 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:47.592329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:47.725895 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:47.733368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-38f1cb73-6119-4722-966d-724deb52246b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.153363 Jun 21 05:58:47.733961 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 314/651] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:47 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:48.183992 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:48.184604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:48.191083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:48.191442 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:48.192226 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:48.192657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:48.331331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:48.339366 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-88b3705b-df4b-4fdf-930e-f11ee053148e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.159316 Jun 21 05:58:48.339928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 338/652] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:48 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:48.751366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:48.751984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:48.755129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:48.760492 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:48.760944 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:48.762094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:48.762555 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:48.900513 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:48.908678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f2a23009-4770-46e5-a95f-d78fc7a5a251 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.161622 Jun 21 05:58:48.909260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 315/653] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:48 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:49.356558 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:49.357183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:49.365272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:49.365716 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:49.366499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:49.366927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:49.498059 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:49.505984 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fb8922b1-4df5-454f-b888-558730a7bd4f tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.153247 Jun 21 05:58:49.506537 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 339/654] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:49 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:49.925652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:49.926296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:49.934475 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:49.934924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:49.935696 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:49.936131 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:50.123399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:50.132024 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-76997c49-6305-4107-9f1e-ab2b51b84eee tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.210771 Jun 21 05:58:50.132601 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 316/655] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:49 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:50.524073 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:50.524689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:50.526803 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:50.528589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=10 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:50.528589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:50.535851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:50.536697 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:50.537245 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:50.559742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:50.689780 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:50.697943 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ccbe56bc-b4c8-4475-866b-250d1d89199d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.178239 Jun 21 05:58:50.698513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 340/656] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:50 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:51.148813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:51.149411 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:51.151252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:51.157212 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:51.157657 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:51.158452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:51.158888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:51.290898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:51.299354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5015a8e7-361b-49e0-b259-0401ea6cd5a9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.154347 Jun 21 05:58:51.299919 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 317/657] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:51 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:51.715877 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:51.716416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:51.723574 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:51.724017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:51.724757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:51.725190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:51.853654 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:51.862423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ef0b4587-035d-4d7c-afb3-ea7080566ec9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.150390 Jun 21 05:58:51.862987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 341/658] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:51 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:52.019352 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:52.019757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:52.025899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.026377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.027150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.027804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.059287 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-28c87c8b-3fe2-4843-8bb4-daea961bb8c2 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments/c71c6288-64c7-44d0-a4eb-6b7bc7beee5f" status: 200 len: 194 microversion: 2.20 time: 0.044661 Jun 21 05:58:52.059878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 318/659] 10.222.0.18 () {60 vars in 1453 bytes} [Tue Jun 21 05:58:52 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments/c71c6288-64c7-44d0-a4eb-6b7bc7beee5f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:58:52.124603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:52.125097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:52.131737 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.132184 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.133007 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.133375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.315834 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:52.316568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:52.326762 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.327395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.328214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.328745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.385702 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lazy-loading 'services' on Instance uuid ec84758b-79f0-4883-8081-9b2b09d7b812 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:58:52.483255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:52.491613 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-677d741c-61b3-4131-8d9c-ea55ba86bd12 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments/c71c6288-64c7-44d0-a4eb-6b7bc7beee5f" status: 202 len: 0 microversion: 2.20 time: 0.370792 Jun 21 05:58:52.495516 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 342/660] 10.222.0.18 () {60 vars in 1456 bytes} [Tue Jun 21 05:58:52 2022] DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments/c71c6288-64c7-44d0-a4eb-6b7bc7beee5f => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:58:52.500614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-82679439-764b-48fe-9f40-c41d37fdf67d req-00cbc756-bebb-482c-9113-424394a59dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a169ff-6c9d-4d88-885a-cb082c72980c", "name": "network-vif-plugged", "status": "completed", "tag": "43fda2d1-d511-44e5-aad7-2e6b22b30b19"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:52.505521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ae57b60e-9bb3-4cb3-acd4-889a17adfd8d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.193213 Jun 21 05:58:52.514728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 319/661] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:52 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:52.514913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-82679439-764b-48fe-9f40-c41d37fdf67d req-00cbc756-bebb-482c-9113-424394a59dff service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.514913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-82679439-764b-48fe-9f40-c41d37fdf67d req-00cbc756-bebb-482c-9113-424394a59dff service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.520265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:52.521432 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:52.529642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.530260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.532561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-82679439-764b-48fe-9f40-c41d37fdf67d req-00cbc756-bebb-482c-9113-424394a59dff service nova] Creating event network-vif-plugged:43fda2d1-d511-44e5-aad7-2e6b22b30b19 for instance 24a169ff-6c9d-4d88-885a-cb082c72980c on hv-cinder-84690 Jun 21 05:58:52.532778 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.533047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.538832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-82679439-764b-48fe-9f40-c41d37fdf67d req-00cbc756-bebb-482c-9113-424394a59dff service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043927 Jun 21 05:58:52.539702 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 343/662] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:52.587304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-deb1d53e-a4c2-4efa-9d3a-a39a2ef8bc90 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075195 Jun 21 05:58:52.594373 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 320/663] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Jun 21 05:58:52 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:58:52.882977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:52.883916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:52.890683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.891114 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:52.892452 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:52.892881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.033552 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:53.043815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7ce770a6-b9b1-465f-b933-55ddf844fec6 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.165987 Jun 21 05:58:53.044979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 344/664] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:52 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:53.523248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:53.523803 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:53.530823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.531271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.532681 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.533124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.608226 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:53.610362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:53.623754 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.624395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.625291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.626298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.669179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-be821d1a-d830-4597-ad39-bff592fb7c55 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.069339 Jun 21 05:58:53.674166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 345/665] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Jun 21 05:58:53 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:53.695392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:53.707159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-55bc55bb-7263-4f77-a5c2-f78a481629ba tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.187928 Jun 21 05:58:53.708105 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 321/666] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:53 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:53.745888 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:53.746501 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:53.753151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.753648 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.754516 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.754939 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.787293 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:58:53.873388 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-98328cdd-f8fc-4b60-aefa-77385924110f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 204 len: 0 microversion: 2.20 time: 0.130740 Jun 21 05:58:53.874019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 346/667] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 21 05:58:53 2022] DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 05:58:53.883117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:53.884027 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:53.890880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.891410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:53.892300 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:53.892772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:54.051434 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:54.061883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:54.062546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:54.064726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:54.066252 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:54.066463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b3e6f92b-16f8-4b4d-bb57-4ff8bb512753 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.187044 Jun 21 05:58:54.067097 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 322/668] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:58:53 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:58:54.074279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:54.075017 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:54.075960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:54.076394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:54.230183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:54.240145 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5b67deab-2473-49f8-afe2-11dc69cb7f16 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.183034 Jun 21 05:58:54.241014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 347/669] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:54 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:54.728294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:54.728902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:54.737188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:54.737746 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:54.738609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:54.739096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:54.888438 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:54.897264 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5e3ea647-ff47-4f12-9a00-04c11329b8db tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1367 microversion: 2.1 time: 0.172758 Jun 21 05:58:54.897851 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 323/670] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:54 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:55.090613 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:55.092645 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:55.106772 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:55.107448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:55.108779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:55.110147 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:55.258489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:55.259439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:55.266594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:55.267177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:55.270402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:55.270402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:55.291336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:55.300921 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:55.302598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:55.303777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-36457f30-7eb1-4a1f-8d2d-4857beda99ab tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.221009 Jun 21 05:58:55.304379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 348/671] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:58:55 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:58:55.418333 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:55.428769 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e497ea32-3f5a-4697-b63f-6d90ff02770c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.174393 Jun 21 05:58:55.429343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 324/672] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:55 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:55.915355 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:55.915966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:55.922432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:55.922853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:55.923612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:55.924063 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.069066 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:56.078122 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5d0374a9-86e4-4954-9779-fa87d0f7689b tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1557 microversion: 2.1 time: 0.166492 Jun 21 05:58:56.079288 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 349/673] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:55 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:56.095723 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:56.096333 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:56.103068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:56.103522 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.104303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:56.104745 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.189091 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-39128761-1e09-47fe-af21-812e6d33444f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097544 Jun 21 05:58:56.189668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 325/674] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:58:56 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:56.325957 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:56.327077 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:56.338993 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:56.339796 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.341375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:56.342213 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.448195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:56.449019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:56.459228 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:56.460190 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.461387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:56.462123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:56.676872 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:56.685956 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:56.687622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:56.689864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a4d7273b-0b94-43f7-ba72-6155940c49c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.371460 Jun 21 05:58:56.690396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 350/675] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:58:56 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:58:56.755001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:56.763540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-87db1f1f-4823-4d7a-96c6-66af23c41651 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.321978 Jun 21 05:58:56.764207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 326/676] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:56 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:58:57.491181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-73558b86-070c-4048-8ee6-dde74e3dc570 req-621881b9-6701-45fc-95c4-d691d7f66b93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a169ff-6c9d-4d88-885a-cb082c72980c", "tag": "43fda2d1-d511-44e5-aad7-2e6b22b30b19"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:57.501624 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-73558b86-070c-4048-8ee6-dde74e3dc570 req-621881b9-6701-45fc-95c4-d691d7f66b93 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:57.502118 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-73558b86-070c-4048-8ee6-dde74e3dc570 req-621881b9-6701-45fc-95c4-d691d7f66b93 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:57.514322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-73558b86-070c-4048-8ee6-dde74e3dc570 req-621881b9-6701-45fc-95c4-d691d7f66b93 service nova] Creating event network-changed:43fda2d1-d511-44e5-aad7-2e6b22b30b19 for instance 24a169ff-6c9d-4d88-885a-cb082c72980c on hv-cinder-84690 Jun 21 05:58:57.520104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-73558b86-070c-4048-8ee6-dde74e3dc570 req-621881b9-6701-45fc-95c4-d691d7f66b93 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033066 Jun 21 05:58:57.520926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 351/677] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:57.708336 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:57.708981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:57.715580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:57.716050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:57.716805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:57.717236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:57.786212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:57.787590 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:57.797283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:57.798044 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:57.799641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:57.800190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:57.916022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:57.924968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:57.926909 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:57.928169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c7286e73-0855-4502-a611-a635791af520 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.224011 Jun 21 05:58:57.928806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 327/678] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:58:57 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:58:57.961666 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:57.970926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ce391214-bf33-4ca7-9a07-f91c133b4aac tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.192763 Jun 21 05:58:57.971831 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 352/679] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:57 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:58:58.570077 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-4c576525-3140-490c-b83d-a255be3ca492 req-ec829719-ce00-4a72-bc30-3f8cb739af20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "name": "network-vif-unplugged", "status": "completed", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:58:58.580022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-4c576525-3140-490c-b83d-a255be3ca492 req-ec829719-ce00-4a72-bc30-3f8cb739af20 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:58.580878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-4c576525-3140-490c-b83d-a255be3ca492 req-ec829719-ce00-4a72-bc30-3f8cb739af20 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:58.595159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-4c576525-3140-490c-b83d-a255be3ca492 req-ec829719-ce00-4a72-bc30-3f8cb739af20 service nova] Creating event network-vif-unplugged:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:58:58.602094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-4c576525-3140-490c-b83d-a255be3ca492 req-ec829719-ce00-4a72-bc30-3f8cb739af20 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036164 Jun 21 05:58:58.602705 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 328/680] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:58:58.945890 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:58.946665 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:58.953201 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:58.954289 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:58.955054 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:58.955482 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:58.989589 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:58:58.990309 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:58:58.997227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:58.997668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:58.998459 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:58:58.998884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:58:59.014984 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:58:59.138919 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:59.148196 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:59.149859 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:59.151147 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ef579611-9477-4b55-b5d6-564349844cd7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1723 microversion: 2.20 time: 0.209203 Jun 21 05:58:59.151799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 353/681] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:58:58 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:58:59.166468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:58:59.179241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-94c8cb98-01b9-454d-b78e-eaff7117770b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.194047 Jun 21 05:58:59.179822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 329/682] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:58:58 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:59:00.169683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:00.171043 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:00.179080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:00.179911 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:00.181358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:00.181794 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:00.200449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:00.204153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:00.227033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:00.228068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:00.229088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:00.230049 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:00.259655 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:00.269535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:00.271333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:00.272703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a0cf596c-773c-4c64-b09f-715d3eeb3e91 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 200 len: 1656 microversion: 2.20 time: 0.106976 Jun 21 05:59:00.277625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 354/683] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:00 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 1656 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:00.376496 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:00.384567 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-917b7657-3a4c-47d0-84ee-2de97af29338 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.189776 Jun 21 05:59:00.385143 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 330/684] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:00 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:59:00.561127 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-6e196fdd-4241-4b2a-9f2b-f10870c5607c req-1d4a5764-a0f4-4119-93fb-ecb89d1798d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec84758b-79f0-4883-8081-9b2b09d7b812", "name": "network-vif-deleted", "tag": "2296aa0a-2dd6-423d-bbf6-f6be5cdf3591"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:00.586538 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6e196fdd-4241-4b2a-9f2b-f10870c5607c req-1d4a5764-a0f4-4119-93fb-ecb89d1798d1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:00.591290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6e196fdd-4241-4b2a-9f2b-f10870c5607c req-1d4a5764-a0f4-4119-93fb-ecb89d1798d1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:00.616553 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-6e196fdd-4241-4b2a-9f2b-f10870c5607c req-1d4a5764-a0f4-4119-93fb-ecb89d1798d1 service nova] Creating event network-vif-deleted:2296aa0a-2dd6-423d-bbf6-f6be5cdf3591 for instance ec84758b-79f0-4883-8081-9b2b09d7b812 on hv-cinder-84690 Jun 21 05:59:00.626156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-6e196fdd-4241-4b2a-9f2b-f10870c5607c req-1d4a5764-a0f4-4119-93fb-ecb89d1798d1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068235 Jun 21 05:59:00.627651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 355/685] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:01.292053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:01.292634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:01.299682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:01.300123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:01.300892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:01.301322 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:01.314706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] HTTP exception thrown: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Request method failure captured: Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 HTTP/1.1 Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisVz7ssD4Co4lI_VifqdAbcMmRp7Ps-aT0RLLkNPiJPSe3BKmb0Tr6y933SpJ4PJwu7t5QgxhyyQ5oZWODeb3qh5Yr_7SJwiyXk6JzP6wOP8G_vPc_itGLney_TqqaKJFUxhC5RZQv3mDPiy4uQh0typJIBHz7L8LbWs8LfN7J3HVmoQ Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:59:01.316377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 7e3e3935d57a48f195a568f90ed25a8a Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 05:59:01.318026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'ec84758b-79f0-4883-8081-9b2b09d7b812'} Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:59:01.318837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 05:59:01.320088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:01.321297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Returning 404 to user: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:59:01.321297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-545a6ba7-53fd-4f7c-a95d-6a5b0f39b8d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 404 len: 111 microversion: 2.20 time: 0.029663 Jun 21 05:59:01.321297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 331/686] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:01 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 05:59:01.328141 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8e2dab64-e2f6-4075-9d72-a44e7f2d94c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '.version_select at 0x7efe5c719d30>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:01.350189 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8e2dab64-e2f6-4075-9d72-a44e7f2d94c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774990968" status: 204 len: 0 microversion: 2.20 time: 0.026821 Jun 21 05:59:01.350776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 356/687] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Jun 21 05:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774990968 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 05:59:01.402858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:01.403914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:01.412432 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:01.412907 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:01.413674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:01.414145 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:01.579811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:01.588226 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b71b8c91-7b3b-4ce1-b6c3-a063e855c1aa tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.189303 Jun 21 05:59:01.599486 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 332/688] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:01 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:59:02.255775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-875623cd-094c-4616-8290-501b08b4af72 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'create', calling method: .version_select at 0x7efe5c7505e0>, body: {"keypair": {"name": "tempest-keypair-2104900756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHNhIgc1LxEGR1YkISToACtyAfWWqicYVgmXLyzSeoT8xaD3Wvo3HtsEe9ZUDhQy3ZC3HEUqWsrnFgxpS8gKEcjN41qy6bLjHJi4M9OeDujE+Dkm0MUmlm3SAE29UtLSew=="}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:02.270541 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-875623cd-094c-4616-8290-501b08b4af72 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for project d71c895fde074698b9717d2a770ef5bf. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:59:02.274348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-875623cd-094c-4616-8290-501b08b4af72 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for user 7e3e3935d57a48f195a568f90ed25a8a and project d71c895fde074698b9717d2a770ef5bf. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:59:02.296323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-875623cd-094c-4616-8290-501b08b4af72 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044464 Jun 21 05:59:02.296946 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 357/689] 10.222.0.18 () {62 vars in 1199 bytes} [Tue Jun 21 05:59:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 21 05:59:02.606603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:02.607203 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:02.613900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:02.614379 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:02.615639 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:02.616014 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:02.780927 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:02.790480 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a2d12bae-93ed-483d-89c4-1ab895a708b3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.187881 Jun 21 05:59:02.791047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 333/690] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:02 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:03.648582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1193515565", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7183839-abdc-439f-b346-d4ec5ebfb8f5"}], "security_groups": [{"name": "tempest-securitygroup--1416864576"}], "key_name": "tempest-keypair-2104900756", "user_data": "}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:03.750269 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] validate_networks() for [('f7183839-abdc-439f-b346-d4ec5ebfb8f5', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:59:03.808201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:03.808729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:03.815200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:03.815650 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:03.816426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:03.816864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:04.012156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:04.020667 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e1a7a6e3-cffc-4390-84d8-79f608b77e77 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.216419 Jun 21 05:59:04.021227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 334/691] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:03 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:59:04.166583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:59:04.166996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:59:04.167457 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:59:04.167853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:59:04.168249 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:59:04.176889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:04.177391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:04.178202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:04.178627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:04.207879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for project d71c895fde074698b9717d2a770ef5bf. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:59:04.212209 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Getting quotas for user 7e3e3935d57a48f195a568f90ed25a8a and project d71c895fde074698b9717d2a770ef5bf. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:59:04.224475 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:59:04.226857 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:59:04.275413 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0f83380a-6bd2-4db5-bb1f-cb7b5ac0f26a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631123 Jun 21 05:59:04.276057 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 358/692] 10.222.0.18 () {62 vars in 1187 bytes} [Tue Jun 21 05:59:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 21 05:59:04.336198 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-69a597fc-9271-4f77-a3d8-31aedfa9b1a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:04.336811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-69a597fc-9271-4f77-a3d8-31aedfa9b1a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:04.396981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-69a597fc-9271-4f77-a3d8-31aedfa9b1a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:04.404487 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-69a597fc-9271-4f77-a3d8-31aedfa9b1a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:04.406099 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-69a597fc-9271-4f77-a3d8-31aedfa9b1a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:04.407200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-69a597fc-9271-4f77-a3d8-31aedfa9b1a4 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1282 microversion: 2.20 time: 0.124852 Jun 21 05:59:04.407922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 335/693] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:04 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:05.039307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:05.039905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:05.046277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:05.047377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:05.048137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:05.048571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:05.066518 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:05.184064 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:05.192695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2a5a1018-1dbe-4ca3-a4fb-a3482a8b3c9c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.158082 Jun 21 05:59:05.193414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 359/694] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:05 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:05.424406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:05.425064 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:05.432351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:05.432805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:05.433549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:05.434006 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:05.500679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:05.516560 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:05.519641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:05.522980 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-48f1aa9a-5e2c-452e-84c1-2e8b299d09da tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1340 microversion: 2.20 time: 0.102074 Jun 21 05:59:05.524325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 336/695] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:05 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:06.210731 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:06.211302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:06.220286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:06.221041 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:06.222297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:06.222749 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:06.354083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:06.362086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4060aad9-a71e-4cc7-953d-5934ed6da8f0 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.155398 Jun 21 05:59:06.362658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 360/696] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:06 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:06.550864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:06.551679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:06.558626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:06.559160 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:06.559995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:06.560645 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:06.657889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-19a0a66d-b742-49a8-9ba7-5240a4380acb req-2eea7a76-c352-4d71-bfce-c8b9e1ea3bbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:06.670877 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-19a0a66d-b742-49a8-9ba7-5240a4380acb req-2eea7a76-c352-4d71-bfce-c8b9e1ea3bbe service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:06.671393 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-19a0a66d-b742-49a8-9ba7-5240a4380acb req-2eea7a76-c352-4d71-bfce-c8b9e1ea3bbe service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:06.713413 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-19a0a66d-b742-49a8-9ba7-5240a4380acb req-2eea7a76-c352-4d71-bfce-c8b9e1ea3bbe service nova] Creating event network-changed:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 05:59:06.720609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-19a0a66d-b742-49a8-9ba7-5240a4380acb req-2eea7a76-c352-4d71-bfce-c8b9e1ea3bbe service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066000 Jun 21 05:59:06.722077 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 361/697] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 05:59:06.759962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:06.772587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:06.774832 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:06.775910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6b7bdf4b-9613-48b1-99a5-1e008679caf7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1408 microversion: 2.20 time: 0.229223 Jun 21 05:59:06.786546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 337/698] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:06 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:07.379779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:07.380476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:07.387123 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:07.387567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:07.388327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:07.388757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:07.518274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:07.529187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e67fb22b-5951-45ac-9361-fd9d960da8c7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.153665 Jun 21 05:59:07.529769 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 362/699] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:07 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:07.794252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:07.794847 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:07.801279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:07.801716 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:07.802507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:07.802932 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:07.936095 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:07.944594 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:07.946114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:07.947495 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-423d5a77-94e2-4d23-90fd-d56d5deceabe tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1408 microversion: 2.20 time: 0.157206 Jun 21 05:59:07.948213 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 338/700] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:07 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:08.659804 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:08.660444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:08.666497 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:08.666947 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:08.667735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:08.668167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:08.799443 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:08.807386 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f7a6050b-b7af-4cf4-a26f-e7e2c2951fc7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.264048 Jun 21 05:59:08.807967 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 363/701] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:08 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:08.969577 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:08.970816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:08.977185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:08.977618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:08.978390 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:08.978814 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:09.108317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:09.117335 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:09.118867 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:09.120120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f1e37ee9-4959-44ac-befb-9ede34382ab7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1408 microversion: 2.20 time: 0.154536 Jun 21 05:59:09.122003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 339/702] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:08 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:09.824338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:09.824954 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:09.831451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:09.831893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:09.832656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:09.833085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:09.961102 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:09.972155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-822a1d31-3f51-4227-8672-4a9a5b3fbffc tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.151624 Jun 21 05:59:09.973035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 364/703] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:09 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:10.137897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:10.138517 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:10.144952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:10.145387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:10.146167 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:10.146596 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:10.275282 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:10.285098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:10.286634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:10.287738 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-84409a36-d502-41b2-9c75-6900ecab63a9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1408 microversion: 2.20 time: 0.153743 Jun 21 05:59:10.288294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 340/704] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:10 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:10.413818 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-4abb8ca9-b4f5-4c4b-a74e-d5b10a5557fb req-c63222bb-5046-4e08-b6b9-d4de478fffe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "name": "network-vif-plugged", "status": "completed", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:10.427343 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-4abb8ca9-b4f5-4c4b-a74e-d5b10a5557fb req-c63222bb-5046-4e08-b6b9-d4de478fffe0 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:10.427918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-4abb8ca9-b4f5-4c4b-a74e-d5b10a5557fb req-c63222bb-5046-4e08-b6b9-d4de478fffe0 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:10.441609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-4abb8ca9-b4f5-4c4b-a74e-d5b10a5557fb req-c63222bb-5046-4e08-b6b9-d4de478fffe0 service nova] Creating event network-vif-plugged:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 05:59:10.446597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-4abb8ca9-b4f5-4c4b-a74e-d5b10a5557fb req-c63222bb-5046-4e08-b6b9-d4de478fffe0 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037218 Jun 21 05:59:10.447489 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 365/705] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:10.988568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:10.989178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:10.995048 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:10.995485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:10.996261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:10.996679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:11.167460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:11.177515 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-30e4bdf8-4ffa-4b34-b31a-2a73cfbb8793 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.192696 Jun 21 05:59:11.178111 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 341/706] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:10 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:11.307430 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:11.308126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:11.315391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:11.315840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:11.316605 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:11.317036 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:11.463768 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:11.473043 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:11.474616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:11.475767 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-52756e67-8137-4119-a569-b395f0506049 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1408 microversion: 2.20 time: 0.173153 Jun 21 05:59:11.476336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 366/707] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:11 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 05:59:12.195138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:12.195743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:12.202248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:12.202630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:12.203378 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:12.204319 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:12.341908 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:12.350269 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-92dae65a-99c6-470c-b960-95a8767e7f71 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.158890 Jun 21 05:59:12.350838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 342/708] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:12 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:12.494362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:12.494907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:12.502631 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:12.503069 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:12.503821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:12.504248 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:12.632086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:12.639872 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:12.641995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:12.643137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9a541e9f-dae3-4040-bf47-1baf0400f726 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1599 microversion: 2.20 time: 0.152736 Jun 21 05:59:12.643688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 367/709] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:12 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 05:59:12.659922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:12.660405 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:12.666684 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:12.667123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:12.667872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:12.668294 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:12.744452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-61c9bb46-6e8a-4064-aaa6-75bb02ec3869 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088256 Jun 21 05:59:12.745041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 343/710] 10.222.0.18 () {60 vars in 1315 bytes} [Tue Jun 21 05:59:12 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:59:13.366996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:13.367511 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:13.369464 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:13.375000 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:13.375454 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:13.376261 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:13.376695 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:13.600006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:13.609845 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-22952197-4e40-4c11-bd28-6bbc61f83ddf tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.246597 Jun 21 05:59:13.610512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 368/711] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:13 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:13.994316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-75ce2868-fc6d-48b9-a364-42f3a9a74c2c req-e43d7029-05cd-4578-aa2a-852fcb4f80e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:14.003329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-75ce2868-fc6d-48b9-a364-42f3a9a74c2c req-e43d7029-05cd-4578-aa2a-852fcb4f80e3 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:14.003888 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-75ce2868-fc6d-48b9-a364-42f3a9a74c2c req-e43d7029-05cd-4578-aa2a-852fcb4f80e3 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:14.015157 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-75ce2868-fc6d-48b9-a364-42f3a9a74c2c req-e43d7029-05cd-4578-aa2a-852fcb4f80e3 service nova] Creating event network-changed:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 05:59:14.021127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-75ce2868-fc6d-48b9-a364-42f3a9a74c2c req-e43d7029-05cd-4578-aa2a-852fcb4f80e3 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030954 Jun 21 05:59:14.021795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 344/712] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:14.626949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:14.628192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:14.630073 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:14.630725 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=10 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:14.636844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:14.637291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:14.638106 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:14.638551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:14.768339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:14.776324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dedf60a2-acf1-484d-ad0f-147bb3fc7357 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.153327 Jun 21 05:59:14.776891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 369/713] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:14 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:59:15.794120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:15.794853 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:15.796780 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:15.803548 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:15.803998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:15.804768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:15.805270 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:15.941003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:15.948936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4021dc59-d4c9-4eb1-9bce-e517343e7fde tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.159039 Jun 21 05:59:15.949490 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 345/714] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:15 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:16.965747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:16.966386 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:16.974000 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:16.974446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:16.975450 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:16.975878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:17.106196 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:17.114866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-785c020d-0bc1-4c15-86f9-3f5c5d774971 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.152915 Jun 21 05:59:17.115852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 370/715] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:16 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:18.131586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:18.132206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:18.138656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:18.139090 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:18.139842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:18.140267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:18.271062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:18.279205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b63cde9d-03d3-4456-b3ac-b40bc95c191b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1733 microversion: 2.1 time: 0.151480 Jun 21 05:59:18.279794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 346/716] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:18 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:19.296642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:19.297246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:19.304301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.304747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.305499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.305955 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.435996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:19.443979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fb041d66-5dbd-425e-a67d-abd79c304ea9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1713 microversion: 2.1 time: 0.151209 Jun 21 05:59:19.444564 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 371/717] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:19 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:19.547833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:19.548367 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:19.550234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=66 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:19.555576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.556020 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.556790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.557228 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.635929 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] HTTP exception thrown: Cannot 'detach_volume' instance 84283f84-8793-4072-8e32-bfec2d2035f2 while it is in vm_state rescued Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Request method failure captured: Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments/8628e2ea-831f-4a45-b2f0-5bbbab2d588b HTTP/1.1 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisVz_Z9TyzhytPasjjVgIW6mOwReV5vngrpMrqo-qW94z2uf63XGuiYeGQbP-gYx6kKffTX8IYYkxgpoWBTCyOGl1niXnbR9nZ0MIzx0r6sAqiLDnvjw4ILhCVFJZimgnZ-_iUJqShtj8viDr3XekjhhIYaBW2Tfjd4klvxi5FulnWX8 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:59:19.637483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f2d23615fd6349e1b70fdbad64b89b78 Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:59:19.639034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Cannot 'detach_volume' instance 84283f84-8793-4072-8e32-bfec2d2035f2 while it is in vm_state rescued Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'server_id': '84283f84-8793-4072-8e32-bfec2d2035f2', 'id': '8628e2ea-831f-4a45-b2f0-5bbbab2d588b'} Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:59:19.639808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 84283f84-8793-4072-8e32-bfec2d2035f2 while it is in vm_state rescued Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 84283f84-8793-4072-8e32-bfec2d2035f2 while it is in vm_state rescued Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:19.641124 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Returning 409 to user: Cannot 'detach_volume' instance 84283f84-8793-4072-8e32-bfec2d2035f2 while it is in vm_state rescued {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:59:19.642829 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-530f0717-d533-4c24-9264-d64b93d78f44 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments/8628e2ea-831f-4a45-b2f0-5bbbab2d588b" status: 409 len: 152 microversion: 2.1 time: 0.095187 Jun 21 05:59:19.642829 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 347/718] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 05:59:19 2022] DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments/8628e2ea-831f-4a45-b2f0-5bbbab2d588b => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 21 05:59:19.650468 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:19.651191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:19.658258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.658701 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.659459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.659917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.725913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b1e335df-8bde-495c-a5c7-1e3f9a69efed tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "POST /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/action" status: 202 len: 0 microversion: 2.1 time: 0.079217 Jun 21 05:59:19.726485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 372/719] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 05:59:19 2022] POST /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:59:19.734898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:19.735438 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:19.741631 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.742195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.743127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:19.743636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:19.878665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:19.880903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:19.889043 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b6beb1f8-8080-4a49-9e60-7a556e2d21af tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1721 microversion: 2.1 time: 0.158021 Jun 21 05:59:19.889544 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 348/720] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:19 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:20.908555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:20.909298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:20.915478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:20.915922 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:20.916678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:20.917107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:21.048444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:21.057345 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-49757bdb-5b34-4264-bf4e-c6951fd0f1ef tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1721 microversion: 2.1 time: 0.154395 Jun 21 05:59:21.057904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 373/721] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:20 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:22.074662 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:22.075257 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:22.082268 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:22.082739 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:22.083494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:22.083922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:22.212049 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:22.220903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b938f781-18f7-49ff-a731-ed7c38d31f81 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1721 microversion: 2.1 time: 0.149335 Jun 21 05:59:22.221740 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 349/722] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:22 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:23.238029 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:23.238633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:23.245085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:23.245529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:23.246305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:23.246740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:23.376409 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:23.384348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0da151f4-a0d3-4e4f-a263-8f43ab7d48fb tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1727 microversion: 2.1 time: 0.150258 Jun 21 05:59:23.384928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 374/723] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:23 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:23.400886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:23.401418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:23.408445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:23.408880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:23.409663 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:23.410123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:23.484787 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c50a438b-19b1-4249-b8c7-7c0baa93371c tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087713 Jun 21 05:59:23.485409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 350/724] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:59:23 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:24.379769 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-2a1bc3b6-5f1e-48cc-9838-a7d58a8d1234 req-53bddef5-5e76-4094-80a5-e7d65b33eec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84283f84-8793-4072-8e32-bfec2d2035f2", "tag": "ac21a55c-508f-45cb-96cc-44152b7643dd"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:24.388610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-2a1bc3b6-5f1e-48cc-9838-a7d58a8d1234 req-53bddef5-5e76-4094-80a5-e7d65b33eec1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:24.389070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-2a1bc3b6-5f1e-48cc-9838-a7d58a8d1234 req-53bddef5-5e76-4094-80a5-e7d65b33eec1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:24.400742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-2a1bc3b6-5f1e-48cc-9838-a7d58a8d1234 req-53bddef5-5e76-4094-80a5-e7d65b33eec1 service nova] Creating event network-changed:ac21a55c-508f-45cb-96cc-44152b7643dd for instance 84283f84-8793-4072-8e32-bfec2d2035f2 on hv-cinder-84690 Jun 21 05:59:24.405904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-2a1bc3b6-5f1e-48cc-9838-a7d58a8d1234 req-53bddef5-5e76-4094-80a5-e7d65b33eec1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030725 Jun 21 05:59:24.406689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 375/725] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:25.269696 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:25.270615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:25.276576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:25.277017 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:25.277765 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:25.278227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:25.307198 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-822ad095-14c1-41b6-8b77-b49d169db8eb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042031 Jun 21 05:59:25.307755 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 351/726] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:59:25 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 05:59:25.364565 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:25.365599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:25.373961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:25.374425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:25.375204 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:25.375639 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:25.401672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:59:25.415831 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:25.477119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-82a2be5c-0af2-4f2a-a00b-6205edbcb6da tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 204 len: 0 microversion: 2.1 time: 0.117200 Jun 21 05:59:25.477836 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 376/727] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:59:25 2022] DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:59:25.487752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:25.488360 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:25.494361 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:25.494805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:25.495567 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:25.496010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:25.628324 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:25.635759 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-41e8fd11-c605-44a8-949c-971924cb7b58 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1674 microversion: 2.1 time: 0.153058 Jun 21 05:59:25.636345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 352/728] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:25 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:26.420557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-4daecd0f-d885-42a8-a93b-03d43c763972 req-a08f6b50-679a-4b98-a473-9aa9df3923cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84283f84-8793-4072-8e32-bfec2d2035f2", "tag": "ac21a55c-508f-45cb-96cc-44152b7643dd"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:26.428988 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-4daecd0f-d885-42a8-a93b-03d43c763972 req-a08f6b50-679a-4b98-a473-9aa9df3923cd service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:26.429424 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-4daecd0f-d885-42a8-a93b-03d43c763972 req-a08f6b50-679a-4b98-a473-9aa9df3923cd service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:26.440263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-4daecd0f-d885-42a8-a93b-03d43c763972 req-a08f6b50-679a-4b98-a473-9aa9df3923cd service nova] Creating event network-changed:ac21a55c-508f-45cb-96cc-44152b7643dd for instance 84283f84-8793-4072-8e32-bfec2d2035f2 on hv-cinder-84690 Jun 21 05:59:26.445060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-4daecd0f-d885-42a8-a93b-03d43c763972 req-a08f6b50-679a-4b98-a473-9aa9df3923cd service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028560 Jun 21 05:59:26.445636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 377/729] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:26.652586 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:26.653166 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:26.659662 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:26.660102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:26.660902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:26.661280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:26.788084 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:26.795472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3c8f76d5-88a0-4bc4-8f65-f13b57d43b10 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1674 microversion: 2.1 time: 0.146763 Jun 21 05:59:26.796029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 353/730] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:26 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:27.814691 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:27.815389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:27.821634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:27.822122 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:27.822896 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:27.823328 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:27.955577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:27.963606 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0f009e6f-51bb-4bbc-a63f-3559bb32aacc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1674 microversion: 2.1 time: 0.154230 Jun 21 05:59:27.973168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 378/731] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:27 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:28.643958 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-5d68b807-3ccb-403b-94f2-ca2a26685bd5 req-a38c02e0-5e46-43b6-9bc7-f1c00f772a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a038cbd5-199a-4273-8ded-1fd9a3528a0e", "name": "network-vif-deleted", "tag": "34000dbd-bc1c-43fa-96d9-b96ba4703a5f"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:28.652587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-5d68b807-3ccb-403b-94f2-ca2a26685bd5 req-a38c02e0-5e46-43b6-9bc7-f1c00f772a44 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:28.653031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-5d68b807-3ccb-403b-94f2-ca2a26685bd5 req-a38c02e0-5e46-43b6-9bc7-f1c00f772a44 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:28.666237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-5d68b807-3ccb-403b-94f2-ca2a26685bd5 req-a38c02e0-5e46-43b6-9bc7-f1c00f772a44 service nova] Creating event network-vif-deleted:34000dbd-bc1c-43fa-96d9-b96ba4703a5f for instance a038cbd5-199a-4273-8ded-1fd9a3528a0e on hv-cinder-84690 Jun 21 05:59:28.671520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-5d68b807-3ccb-403b-94f2-ca2a26685bd5 req-a38c02e0-5e46-43b6-9bc7-f1c00f772a44 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031622 Jun 21 05:59:28.675128 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 354/732] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:28.981221 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:28.981851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:28.992116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:28.992873 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:28.993691 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:28.998418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:29.031661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:29.032126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:29.032573 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lazy-loading 'fault' on Instance uuid a038cbd5-199a-4273-8ded-1fd9a3528a0e {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:59:29.086171 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:29.101704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4d56d21f-8eab-413e-944a-b99b0e60b59c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 200 len: 1327 microversion: 2.1 time: 0.124254 Jun 21 05:59:29.102820 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 379/733] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:28 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 1327 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:30.121824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:30.122563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:30.128883 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:30.129327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:30.130123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:30.130558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:30.144945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] HTTP exception thrown: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Request method failure captured: Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e HTTP/1.1 Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0CEODwqigzhUaQ7i3f0wH-ccGUc2zK__lqpMKaE9IiJnoAd5RtVlixi7gr9yZ7St9datBPvogJTTkbpLaqz5bnPVBpnLhNFJN1STgXs-zMBqNOs0B8MMdvGBOM1A-7uP-bz21bxxWAXhaVGH3XZHa-woYOphHv_oiN08HH9dN5ZZE Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:59:30.146668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219135be95384a599a7c8e7df72175c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219135be95384a599a7c8e7df72175c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeTestJSON-1746648515 Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: abd380b05ae94a29bdf56c529f1d411e Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 05:59:30.148292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'a038cbd5-199a-4273-8ded-1fd9a3528a0e'} Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:59:30.149280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 05:59:30.150789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:30.152133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Returning 404 to user: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:59:30.152133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b9468a64-312c-4d41-8275-ed35705146b4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 404 len: 111 microversion: 2.1 time: 0.031364 Jun 21 05:59:30.152133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 355/734] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:30 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:59:30.157788 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-aba7c389-059e-420d-adc5-7d240b75c7ce tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '.version_select at 0x7efe5c6a9820>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:30.176571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-aba7c389-059e-420d-adc5-7d240b75c7ce tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187453177" status: 202 len: 0 microversion: 2.1 time: 0.023181 Jun 21 05:59:30.177151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 380/735] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 21 05:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1187453177 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:59:30.809042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8887f114-fefa-4a43-9757-c12645a5ee5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: .version_select at 0x7efe5c69be50>, body: {"keypair": {"name": "tempest-keypair-496200247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIpsv6ZnnM5gF+nUv9FPlRhciFITuIZGFATdkwMrQze+ZCIh9Z2xF0TGl3U6f5Jj69KMEeV5J3zNG61I/Z8/JxEf0LfFq9YxRlh6XUNHbimrU+dvyNPKdsWxz3VooVTMtg=="}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:30.823330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-8887f114-fefa-4a43-9757-c12645a5ee5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for project 219135be95384a599a7c8e7df72175c2. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:59:30.827056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-8887f114-fefa-4a43-9757-c12645a5ee5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for user abd380b05ae94a29bdf56c529f1d411e and project 219135be95384a599a7c8e7df72175c2. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:59:30.848713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8887f114-fefa-4a43-9757-c12645a5ee5c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043503 Jun 21 05:59:30.849329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 356/736] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:59:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:32.096137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1407268566", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d1a065d-e112-4f81-9899-4ee12e5c17d1"}], "security_groups": [{"name": "tempest-securitygroup--1208851933"}], "key_name": "tempest-keypair-496200247", "user_data": "}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:32.448356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] validate_networks() for [('0d1a065d-e112-4f81-9899-4ee12e5c17d1', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:59:32.920215 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:59:32.920638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:59:32.921102 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:59:32.921520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:59:32.921954 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:59:32.931700 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:32.932140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:32.932927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:32.933361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:32.950020 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for project 219135be95384a599a7c8e7df72175c2. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:59:32.954658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Getting quotas for user abd380b05ae94a29bdf56c529f1d411e and project 219135be95384a599a7c8e7df72175c2. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:59:32.965655 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:59:32.968143 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:59:33.013253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0966161a-d3de-402c-a512-187773a8ef43 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.922170 Jun 21 05:59:33.013898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 381/737] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:59:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:59:33.025288 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4a543d82-07f3-40e3-920e-8cf7b83d47f4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:33.025879 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4a543d82-07f3-40e3-920e-8cf7b83d47f4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:33.082435 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4a543d82-07f3-40e3-920e-8cf7b83d47f4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:33.089271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4a543d82-07f3-40e3-920e-8cf7b83d47f4 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1237 microversion: 2.1 time: 0.068417 Jun 21 05:59:33.089842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 357/738] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:33 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:33.902931 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:33.903486 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:33.910539 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:33.910980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:33.911747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:33.912178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:33.935302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3909cef1-73a7-4f1a-b9fc-82852058b28e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/ips" status: 200 len: 149 microversion: 2.1 time: 0.205929 Jun 21 05:59:33.935878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 382/739] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 05:59:33 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/ips => generated 149 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:34.107846 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:34.114626 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:34.122466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:34.122918 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:34.123778 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:34.124406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:34.247991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:34.256282 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-44aefabf-381b-4172-aefa-c338b26379ba tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1297 microversion: 2.1 time: 0.152763 Jun 21 05:59:34.256854 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 358/740] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:34 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:35.275383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:35.275991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:35.285267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:35.285710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:35.286503 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:35.286933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:35.336921 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "304a831b-4068-4f0d-a9d2-328fc49d6970"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:35.338100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:35.345313 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:35.345859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:35.346678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:35.347179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:35.449090 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:35.458008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fefb159e-124a-41c3-bf0f-44ebbdf7b7fb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.186290 Jun 21 05:59:35.459259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 383/741] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:35 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:35.630078 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5f6cd475-fcec-4822-a0f2-f00e8d2aa549 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296846 Jun 21 05:59:35.631563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 359/742] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:59:35 2022] POST /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:35.731282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-5ab8c000-8edd-49eb-a9c5-33eb4be153c5 req-d4f1bf37-d62d-43da-8e8a-e631743e9545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919fe9b8-52bd-465b-ac3f-bd338e6afade", "tag": "831f473c-b089-4dc2-87af-a6d77639006e"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:35.745124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-5ab8c000-8edd-49eb-a9c5-33eb4be153c5 req-d4f1bf37-d62d-43da-8e8a-e631743e9545 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:35.745571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-5ab8c000-8edd-49eb-a9c5-33eb4be153c5 req-d4f1bf37-d62d-43da-8e8a-e631743e9545 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:35.758149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-5ab8c000-8edd-49eb-a9c5-33eb4be153c5 req-d4f1bf37-d62d-43da-8e8a-e631743e9545 service nova] Creating event network-changed:831f473c-b089-4dc2-87af-a6d77639006e for instance 919fe9b8-52bd-465b-ac3f-bd338e6afade on hv-cinder-84690 Jun 21 05:59:35.763449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-5ab8c000-8edd-49eb-a9c5-33eb4be153c5 req-d4f1bf37-d62d-43da-8e8a-e631743e9545 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041507 Jun 21 05:59:35.764318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 384/743] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:36.476472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:36.477093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:36.483634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:36.484080 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:36.484846 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:36.485278 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:36.613746 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:36.621181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2862ad3f-c988-4321-970a-02251ae0be97 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.149487 Jun 21 05:59:36.621738 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 360/744] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:36 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:37.639638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:37.640330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:37.647014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:37.647522 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:37.648274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:37.648700 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:37.799770 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:37.807216 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d4554ff3-c73b-4417-a222-cbe48cb20798 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.172489 Jun 21 05:59:37.807795 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 385/745] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:37 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:38.824465 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:38.825072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:38.831711 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:38.832145 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:38.832916 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:38.833352 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:38.935023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "304a831b-4068-4f0d-a9d2-328fc49d6970"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:38.936131 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:38.942758 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:38.943300 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:38.944124 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:38.944556 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:38.970444 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:38.978022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-95160258-74b5-46bd-822d-bb55f833522e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.157361 Jun 21 05:59:38.978615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 361/746] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:38 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:39.024557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Invalid volume: volume 304a831b-4068-4f0d-a9d2-328fc49d6970 is already attached to instances: 24a169ff-6c9d-4d88-885a-cb082c72980c Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: POST /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments HTTP/1.1 Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 74 Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 05:59:39.026297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {"volumeAttachment": {"volumeId": "304a831b-4068-4f0d-a9d2-328fc49d6970"}} Jun 21 05:59:39.027856 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Invalid volume: volume 304a831b-4068-4f0d-a9d2-328fc49d6970 is already attached to instances: 24a169ff-6c9d-4d88-885a-cb082c72980c Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'server_id': '24a169ff-6c9d-4d88-885a-cb082c72980c', 'body': {'volumeAttachment': {'volumeId': '304a831b-4068-4f0d-a9d2-328fc49d6970'}}} Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 304a831b-4068-4f0d-a9d2-328fc49d6970 is already attached to instances: 24a169ff-6c9d-4d88-885a-cb082c72980c Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:59:39.028800 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 304a831b-4068-4f0d-a9d2-328fc49d6970 is already attached to instances: 24a169ff-6c9d-4d88-885a-cb082c72980c Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:39.030283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 304a831b-4068-4f0d-a9d2-328fc49d6970 is already attached to instances: 24a169ff-6c9d-4d88-885a-cb082c72980c Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 400 to user: Invalid volume: volume 304a831b-4068-4f0d-a9d2-328fc49d6970 is already attached to instances: 24a169ff-6c9d-4d88-885a-cb082c72980c {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e3afb83c-f355-48bb-8d21-3617cc22e4f9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097009 Jun 21 05:59:39.032303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 386/747] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 05:59:38 2022] POST /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 21 05:59:39.090423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:39.090918 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:39.097793 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:39.098260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:39.099031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:39.099456 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:39.183710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'services' on Instance uuid 24a169ff-6c9d-4d88-885a-cb082c72980c {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:59:39.256288 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7e2d6dc5-68f8-4b90-bded-6147ddc3f4f3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments/304a831b-4068-4f0d-a9d2-328fc49d6970" status: 202 len: 0 microversion: 2.1 time: 0.169694 Jun 21 05:59:39.257000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 362/748] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 05:59:39 2022] DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments/304a831b-4068-4f0d-a9d2-328fc49d6970 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:59:39.267064 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:39.268130 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:39.277496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:39.278067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:39.278917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:39.279381 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:39.309566 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dd3767b3-5458-4599-84f7-b0b89fa1f1f0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047861 Jun 21 05:59:39.310157 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 387/749] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:59:39 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:39.995732 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:39.996427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:40.003346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.003791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.004546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.004976 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.138232 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:40.146493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f1518b8b-27b9-4fd6-be8d-17eac0d9144e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.155244 Jun 21 05:59:40.147201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 363/750] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:39 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:40.320824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:40.321628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:40.328051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.328495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.329241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.329668 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.360398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8102d1c4-80ad-4782-9c38-63b04666545e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042859 Jun 21 05:59:40.360992 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 388/751] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 05:59:40 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 05:59:40.435807 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:40.436403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:40.442336 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.442787 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.443563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.443997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.470758 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 05:59:40.556000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d6db719b-6840-4a9c-b394-f7ce977d51a2 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 204 len: 0 microversion: 2.1 time: 0.123895 Jun 21 05:59:40.557016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 364/752] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 05:59:40 2022] DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:59:40.563686 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-3682ca38-f7c8-402f-914b-76b9aac9a21e req-a118ee80-b8f0-4030-9c64-68c458613cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919fe9b8-52bd-465b-ac3f-bd338e6afade", "name": "network-vif-plugged", "status": "completed", "tag": "831f473c-b089-4dc2-87af-a6d77639006e"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:40.566106 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:40.567000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:40.572894 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-3682ca38-f7c8-402f-914b-76b9aac9a21e req-a118ee80-b8f0-4030-9c64-68c458613cbc service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.573171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.573307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-3682ca38-f7c8-402f-914b-76b9aac9a21e req-a118ee80-b8f0-4030-9c64-68c458613cbc service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.573638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.574427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:40.574864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:40.589784 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-3682ca38-f7c8-402f-914b-76b9aac9a21e req-a118ee80-b8f0-4030-9c64-68c458613cbc service nova] Creating event network-vif-plugged:831f473c-b089-4dc2-87af-a6d77639006e for instance 919fe9b8-52bd-465b-ac3f-bd338e6afade on hv-cinder-84690 Jun 21 05:59:40.591624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:40.596483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-3682ca38-f7c8-402f-914b-76b9aac9a21e req-a118ee80-b8f0-4030-9c64-68c458613cbc service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036428 Jun 21 05:59:40.597393 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 389/753] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:40.719535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:40.727174 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-88811fa2-8387-4537-87fb-26d737e9c0c4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1681 microversion: 2.1 time: 0.165784 Jun 21 05:59:40.727785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 365/754] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:40 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 05:59:41.164041 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:41.164650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:41.170863 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:41.171302 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:41.172578 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:41.173005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:41.303156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:41.310571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7da24c85-8f9b-4152-ba38-0e8e9178f7a1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.150872 Jun 21 05:59:41.311134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 390/755] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:41 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:41.745061 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:41.745651 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:41.752356 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:41.752788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:41.753547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:41.753997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:41.885862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:41.894843 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-37258011-a271-48e2-81a1-f979e782771a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1681 microversion: 2.1 time: 0.153651 Jun 21 05:59:41.895403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 366/756] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:41 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:42.329660 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:42.330560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:42.344492 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:42.345076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:42.346085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:42.346524 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:42.479755 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:42.487385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fa201430-ef46-4077-a606-b8cac7dd348c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.162446 Jun 21 05:59:42.487960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 391/757] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:42 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:42.911198 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:42.911787 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:42.918397 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:42.918928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:42.919770 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:42.920301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:42.983547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:42.991536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1953e489-d103-4821-a659-d9c5e2264056 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1613 microversion: 2.1 time: 0.084244 Jun 21 05:59:42.992113 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 367/758] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:42 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:43.088652 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-ada44058-2608-4717-958e-fa51689cc6e7 req-7bbf07b4-275c-44c5-b43b-5a6bf7c089d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a169ff-6c9d-4d88-885a-cb082c72980c", "name": "network-vif-deleted", "tag": "43fda2d1-d511-44e5-aad7-2e6b22b30b19"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:43.092586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:43.093243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=6 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:43.100504 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ada44058-2608-4717-958e-fa51689cc6e7 req-7bbf07b4-275c-44c5-b43b-5a6bf7c089d4 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:43.101100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ada44058-2608-4717-958e-fa51689cc6e7 req-7bbf07b4-275c-44c5-b43b-5a6bf7c089d4 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:43.115428 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-ada44058-2608-4717-958e-fa51689cc6e7 req-7bbf07b4-275c-44c5-b43b-5a6bf7c089d4 service nova] Creating event network-vif-deleted:43fda2d1-d511-44e5-aad7-2e6b22b30b19 for instance 24a169ff-6c9d-4d88-885a-cb082c72980c on hv-cinder-84690 Jun 21 05:59:43.120647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-ada44058-2608-4717-958e-fa51689cc6e7 req-7bbf07b4-275c-44c5-b43b-5a6bf7c089d4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035641 Jun 21 05:59:43.121584 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 392/759] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:43.503960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:43.504563 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:43.506637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=6 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:43.512489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:43.512936 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:43.513791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:43.514270 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:43.648709 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:43.656859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fe82037d-7834-4b8a-8f65-93e5bb4cfe45 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1363 microversion: 2.1 time: 0.156110 Jun 21 05:59:43.657535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 368/760] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:43 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:44.010026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:44.010735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:44.012726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:44.020046 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.020497 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.021262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.021694 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.056444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.056885 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.057336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'fault' on Instance uuid 24a169ff-6c9d-4d88-885a-cb082c72980c {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:59:44.101373 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:44.108871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0128adea-b504-4159-819f-44d42dc5f4a3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 200 len: 1331 microversion: 2.1 time: 0.103538 Jun 21 05:59:44.109827 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 393/761] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:44 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:44.674023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:44.674628 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:44.681686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.682163 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.683056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.683498 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.814252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:44.821906 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c98f24c5-e1a3-48f9-818b-42dfc5bae6cc tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1548 microversion: 2.1 time: 0.152288 Jun 21 05:59:44.822509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 369/762] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:44 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:44.838075 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:44.838574 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:44.845871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.846345 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.847132 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:44.847598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:44.930312 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5ee2bfd2-c2b2-4ca0-9b72-0c97a80db331 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096029 Jun 21 05:59:44.930911 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 394/763] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:59:44 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:45.126511 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:45.127115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:45.133134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:45.133583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:45.134387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:45.134819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:45.149467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c HTTP/1.1 Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 05:59:45.151196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 05:59:45.152728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '24a169ff-6c9d-4d88-885a-cb082c72980c'} Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 05:59:45.157483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 05:59:45.158925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 05:59:45.160199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 05:59:45.160199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-22bf6b6f-4834-4e31-8e12-31ba19c6b887 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 404 len: 111 microversion: 2.1 time: 0.029953 Jun 21 05:59:45.160199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 370/764] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:45 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 05:59:45.161750 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5119c718-9eca-4af7-ae0a-53daebe80828 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '.version_select at 0x7efe5c6150d0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:45.179459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5119c718-9eca-4af7-ae0a-53daebe80828 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-752369924" status: 202 len: 0 microversion: 2.1 time: 0.021176 Jun 21 05:59:45.179996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 395/765] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Jun 21 05:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-752369924 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 05:59:45.814852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-724a9410-7065-4f34-a11a-6f7752b0e2b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: .version_select at 0x7efe5c6c8790>, body: {"keypair": {"name": "tempest-keypair-1510966619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgmFr8plDfGHsc7QHUJ2Sh1BORMOJ6mofrL1fW9xnhKu5gCSUpg/GOGv5ij091na6hyJkgATSfa3cBDFqwbLMSU7tUaXVrUrafWjf5ZC20qsRyTUgKIduCCDmjuDKjk6Q=="}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:45.829076 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-724a9410-7065-4f34-a11a-6f7752b0e2b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:59:45.833361 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-724a9410-7065-4f34-a11a-6f7752b0e2b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:59:45.862040 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-724a9410-7065-4f34-a11a-6f7752b0e2b3 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051550 Jun 21 05:59:45.863142 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 371/766] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 05:59:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:45.947331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-cd821a14-23fa-49c9-90e9-0e81f2642ba4 req-652abe2c-1f76-4d11-9202-a56a3d9f51ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "919fe9b8-52bd-465b-ac3f-bd338e6afade", "tag": "831f473c-b089-4dc2-87af-a6d77639006e"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:45.958905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-cd821a14-23fa-49c9-90e9-0e81f2642ba4 req-652abe2c-1f76-4d11-9202-a56a3d9f51ad service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:45.959775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-cd821a14-23fa-49c9-90e9-0e81f2642ba4 req-652abe2c-1f76-4d11-9202-a56a3d9f51ad service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:45.971870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-cd821a14-23fa-49c9-90e9-0e81f2642ba4 req-652abe2c-1f76-4d11-9202-a56a3d9f51ad service nova] Creating event network-changed:831f473c-b089-4dc2-87af-a6d77639006e for instance 919fe9b8-52bd-465b-ac3f-bd338e6afade on hv-cinder-84690 Jun 21 05:59:45.977753 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-cd821a14-23fa-49c9-90e9-0e81f2642ba4 req-652abe2c-1f76-4d11-9202-a56a3d9f51ad service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101292 Jun 21 05:59:45.978755 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 396/767] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:47.233637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1230353316", "imageRef": "c0f3ada4-dd03-480e-bc2d-58c4c51179dd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af2e04db-de33-4272-99f0-75327f84c194"}], "security_groups": [{"name": "tempest-securitygroup--1882628683"}], "key_name": "tempest-keypair-1510966619", "user_data": "}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:47.340262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] validate_networks() for [('af2e04db-de33-4272-99f0-75327f84c194', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 05:59:47.756812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 05:59:47.757223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 05:59:47.757687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 05:59:47.758127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 05:59:47.758540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 05:59:47.767648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:47.768028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:47.768860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:47.769296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:47.786614 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 05:59:47.790668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Getting quotas for user f4cd1d7c5a4a4b658f7abf8e434cf716 and project ed1571657afc4ffd9fa9125c251de2c8. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 05:59:47.802301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 05:59:47.804571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f3ada4-dd03-480e-bc2d-58c4c51179dd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 05:59:47.850819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-494cc84e-0431-470c-9420-deee02247eca tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.622218 Jun 21 05:59:47.851452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 372/768] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 05:59:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 05:59:47.863181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9fca2b20-36be-4fa3-9703-bbbb11ac01ae tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:47.864008 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9fca2b20-36be-4fa3-9703-bbbb11ac01ae tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:47.922205 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9fca2b20-36be-4fa3-9703-bbbb11ac01ae tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:47.929282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9fca2b20-36be-4fa3-9703-bbbb11ac01ae tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1242 microversion: 2.1 time: 0.071431 Jun 21 05:59:47.929869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 397/769] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:47 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:48.947175 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:48.948017 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:48.955157 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:48.955610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:48.956387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:48.957018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:49.027624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:49.035436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-36bfd1fb-cd8d-4bf2-be66-e4407ff6ffb9 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1300 microversion: 2.1 time: 0.092886 Jun 21 05:59:49.035998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 373/770] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:48 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:50.054239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:50.054885 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:50.068823 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:50.069698 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:50.071219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:50.071851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:50.222270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:50.229961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fc3c4b6e-b5d6-4290-8115-6c9fc5de7d80 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1368 microversion: 2.1 time: 0.180279 Jun 21 05:59:50.230555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 398/771] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:50 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:50.410998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-b20d474d-d07a-428a-addd-5fc8a231fae4 req-ff381f5b-bd90-4d07-b764-dc2cd711b69a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0106c2-482c-45bf-9b59-c362ffa6ba8c", "tag": "5ae1b537-6fae-4629-973f-7680b8a4a4f5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:50.416144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:50.423461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-b20d474d-d07a-428a-addd-5fc8a231fae4 req-ff381f5b-bd90-4d07-b764-dc2cd711b69a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:50.424769 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-b20d474d-d07a-428a-addd-5fc8a231fae4 req-ff381f5b-bd90-4d07-b764-dc2cd711b69a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:50.439634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-b20d474d-d07a-428a-addd-5fc8a231fae4 req-ff381f5b-bd90-4d07-b764-dc2cd711b69a service nova] Creating event network-changed:5ae1b537-6fae-4629-973f-7680b8a4a4f5 for instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c on hv-cinder-84690 Jun 21 05:59:50.444799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-b20d474d-d07a-428a-addd-5fc8a231fae4 req-ff381f5b-bd90-4d07-b764-dc2cd711b69a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038890 Jun 21 05:59:50.445646 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 374/772] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:51.246927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:51.247620 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:51.254519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:51.254964 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:51.255779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:51.256212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:51.260874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:51.391626 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:51.399039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-de6be512-f555-4427-a17f-1ea1282d8e7a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1368 microversion: 2.1 time: 0.155979 Jun 21 05:59:51.399619 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 399/773] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:51 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:52.418899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:52.419493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:52.426383 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:52.426823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:52.427575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:52.428004 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:52.578761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:52.586914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-67c677ab-d699-4675-8b6b-04a20494226e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1368 microversion: 2.1 time: 0.172826 Jun 21 05:59:52.587491 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 375/774] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:52 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:53.604794 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:53.605395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:53.612596 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:53.613036 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:53.613777 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:53.614231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:53.743773 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:53.751375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-32c4267c-b36f-47f6-9adf-e692e411140e tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1368 microversion: 2.1 time: 0.150401 Jun 21 05:59:53.751932 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 400/775] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:53 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:54.595552 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-a3a5c763-b5cf-475b-9703-9d1e6cd6f8ab req-090820f4-cd17-4402-8241-3257e6690d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0106c2-482c-45bf-9b59-c362ffa6ba8c", "name": "network-vif-plugged", "status": "completed", "tag": "5ae1b537-6fae-4629-973f-7680b8a4a4f5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:54.604359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-a3a5c763-b5cf-475b-9703-9d1e6cd6f8ab req-090820f4-cd17-4402-8241-3257e6690d3c service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:54.604880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-a3a5c763-b5cf-475b-9703-9d1e6cd6f8ab req-090820f4-cd17-4402-8241-3257e6690d3c service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:54.616964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-a3a5c763-b5cf-475b-9703-9d1e6cd6f8ab req-090820f4-cd17-4402-8241-3257e6690d3c service nova] Creating event network-vif-plugged:5ae1b537-6fae-4629-973f-7680b8a4a4f5 for instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c on hv-cinder-84690 Jun 21 05:59:54.621879 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-a3a5c763-b5cf-475b-9703-9d1e6cd6f8ab req-090820f4-cd17-4402-8241-3257e6690d3c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030355 Jun 21 05:59:54.622507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 376/776] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:54.768232 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:54.768763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:54.775323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:54.775767 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:54.776627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:54.776971 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:54.920341 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:54.928376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2b146726-c831-4b09-bbf3-7037d27c02d1 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1368 microversion: 2.1 time: 0.164082 Jun 21 05:59:54.928961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 401/777] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:54 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:55.947151 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:55.947842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:55.954710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:55.955157 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:55.955920 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:55.956351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:56.088349 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:56.096540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7f8edf6a-68b9-4f61-a23c-6f2fce0237dd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1368 microversion: 2.1 time: 0.154130 Jun 21 05:59:56.097118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 377/778] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:55 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:57.113854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:57.114838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:57.121239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:57.121685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:57.122502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:57.122948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:57.263761 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:57.272068 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2072b796-5876-4676-a679-622177039b71 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1559 microversion: 2.1 time: 0.161993 Jun 21 05:59:57.272565 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 402/779] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 05:59:57 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 05:59:57.288921 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:57.289464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:57.296073 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:57.296514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:57.297271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:57.297700 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:57.378954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c0828fcc-8071-4ad4-97c6-8d6704945599 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093889 Jun 21 05:59:57.379682 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 378/780] 10.222.0.18 () {58 vars in 1274 bytes} [Tue Jun 21 05:59:57 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:57.662699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:57.666744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:57.675252 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:57.676622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:57.677402 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:57.677834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:57.724642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-77fa01d8-302d-49a2-b0bd-0fe41fdb4770 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/ips" status: 200 len: 150 microversion: 2.20 time: 0.065598 Jun 21 05:59:57.731016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 403/781] 10.222.0.18 () {60 vars in 1288 bytes} [Tue Jun 21 05:59:57 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 05:59:58.394403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:58.395303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=10 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:58.461957 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-c75661d3-4156-409e-b914-927a863827c8 req-eecbcf04-c0bd-453e-8616-d67efb83ed9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0106c2-482c-45bf-9b59-c362ffa6ba8c", "tag": "5ae1b537-6fae-4629-973f-7680b8a4a4f5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:58.471597 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-c75661d3-4156-409e-b914-927a863827c8 req-eecbcf04-c0bd-453e-8616-d67efb83ed9a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:58.472032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-c75661d3-4156-409e-b914-927a863827c8 req-eecbcf04-c0bd-453e-8616-d67efb83ed9a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:58.484450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-c75661d3-4156-409e-b914-927a863827c8 req-eecbcf04-c0bd-453e-8616-d67efb83ed9a service nova] Creating event network-changed:5ae1b537-6fae-4629-973f-7680b8a4a4f5 for instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c on hv-cinder-84690 Jun 21 05:59:58.489731 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-c75661d3-4156-409e-b914-927a863827c8 req-eecbcf04-c0bd-453e-8616-d67efb83ed9a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095876 Jun 21 05:59:58.490384 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 379/782] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 05:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 05:59:59.528258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 05:59:59.528815 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:59.530678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 05:59:59.536500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:59.536949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:59.537716 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:59.538214 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:59.568969 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lazy-loading 'flavor' on Instance uuid f352939b-c3a3-4788-b6f2-22319aa6e044 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 05:59:59.829957 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-815e3246-c472-4063-be4d-8816f2821305 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/action" status: 202 len: 0 microversion: 2.20 time: 0.305455 Jun 21 05:59:59.830569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 404/783] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 21 05:59:59 2022] POST /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 05:59:59.839613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 05:59:59.840387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 05:59:59.847428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:59.847877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:59.848630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 05:59:59.849066 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 05:59:59.985394 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:59.993237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:59.994752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 05:59:59.995928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-63395d67-74cb-4d7f-9078-160df5fa8930 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.161049 Jun 21 05:59:59.996474 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 380/784] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 05:59:59 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:01.015570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:01.016262 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:01.022750 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:01.023145 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:01.023904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:01.024350 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:01.156967 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:01.164945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:01.166481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:01.167641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-57071e9d-dbfc-442f-968b-909579e241c3 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.156793 Jun 21 06:00:01.168203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 405/785] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:01 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:02.189769 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:02.190393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:02.196866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:02.197304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:02.198091 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:02.198521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:02.327419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:02.335366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:02.336847 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:02.338016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ad16ccb4-5076-4543-b6f2-1984ccbdac56 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.152794 Jun 21 06:00:02.338600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 381/786] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:02 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:03.207584 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:03.208111 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:03.214604 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:03.215045 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:03.215836 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:03.216532 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:03.296383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'services' on Instance uuid 84283f84-8793-4072-8e32-bfec2d2035f2 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:00:03.356327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:03.356994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:03.363716 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:03.364160 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:03.364924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:03.365403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:03.370337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-049529b7-3c98-44b5-a3a9-79953dfe2ee4 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments/8628e2ea-831f-4a45-b2f0-5bbbab2d588b" status: 202 len: 0 microversion: 2.1 time: 0.166420 Jun 21 06:00:03.371389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 406/787] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 06:00:03 2022] DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments/8628e2ea-831f-4a45-b2f0-5bbbab2d588b => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:00:03.381184 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:03.382316 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:03.389009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:03.390100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:03.390989 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:03.391503 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:03.427329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-99fcc856-59ca-46a1-8157-d0fcfcbab096 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051149 Jun 21 06:00:03.427903 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 407/788] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:00:03 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:00:03.744600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:03.753121 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:03.754669 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:03.755815 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fce112a1-43a2-4bdf-955d-d4631e1150e8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.403415 Jun 21 06:00:03.756368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 382/789] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:03 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:04.439173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:04.440092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:04.446827 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.447270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.448033 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.448463 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.479951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-981fe0af-d687-4036-9582-86e02c320cb3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044703 Jun 21 06:00:04.480517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 408/790] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:00:04 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 06:00:04.568238 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:04.568818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:04.577592 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.578450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.579585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.580025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.612418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:00:04.688678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1df1ce73-432e-4aea-8031-45f47744c87a tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 204 len: 0 microversion: 2.1 time: 0.126524 Jun 21 06:00:04.689446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 383/791] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:00:04 2022] DELETE /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:00:04.698897 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:04.699883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:04.706712 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.707149 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.707908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.708354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.774547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:04.775354 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:04.782011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.782538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.783370 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:04.783804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:04.869790 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:04.878465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-76afe0ac-dc56-492f-8fce-e638c13c4e7e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1687 microversion: 2.1 time: 0.184879 Jun 21 06:00:04.879036 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 409/792] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:04 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:04.929910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:04.938482 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:04.940023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:04.941116 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7c34af37-419a-4777-9c43-ef9e5e253da6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.170875 Jun 21 06:00:04.941669 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 384/793] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:04 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:05.895863 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:05.896462 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:05.902987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:05.903432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:05.904183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:05.904610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:05.959527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:05.960128 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:05.966996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:05.968028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:05.968794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:05.969227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:05.973501 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:06.079369 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:06.087418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-633aae69-6e0a-4b5e-923f-c79414190e14 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1687 microversion: 2.1 time: 0.195363 Jun 21 06:00:06.087989 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 410/794] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:05 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1687 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:06.124775 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:06.132637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:06.134159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:06.135300 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a9f37382-5af1-420f-908e-cded1d18b5a7 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.179652 Jun 21 06:00:06.135847 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 385/795] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:05 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:07.104646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:07.105249 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:07.111535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:07.111982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:07.112776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:07.113206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:07.155185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:07.155844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:07.163310 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:07.163540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:07.164230 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:07.164670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:07.306298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:07.314866 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8e51c660-45d0-4581-aa78-62a283c36901 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1687 microversion: 2.1 time: 0.213933 Jun 21 06:00:07.315450 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 411/796] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:07 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1687 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:07.333961 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:07.342297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:07.343754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:07.344901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5308aab7-46bb-471b-82f3-f04cf95f75d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.195211 Jun 21 06:00:07.345453 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 386/797] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:07 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:08.332529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:08.333102 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:08.339749 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:08.340194 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:08.340952 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:08.341644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:08.364923 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:08.366018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:08.376220 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:08.376894 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:08.378185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:08.378856 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:08.556812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:08.569992 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-18651ef5-61a5-4d3f-88de-321dff77f456 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1687 microversion: 2.1 time: 0.240950 Jun 21 06:00:08.570971 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 412/798] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:08 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1687 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:08.573218 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:08.586010 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:08.587542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:08.588823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2e4254c5-8473-43fb-af3d-51277ab83b13 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.229125 Jun 21 06:00:08.589776 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 387/799] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:08 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:09.384292 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-d24153bb-bcc0-4869-bd26-bc3e3a3b489e req-21ac2fef-7064-4b39-8332-8e7f6201fe2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84283f84-8793-4072-8e32-bfec2d2035f2", "name": "network-vif-deleted", "tag": "ac21a55c-508f-45cb-96cc-44152b7643dd"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:09.395832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-d24153bb-bcc0-4869-bd26-bc3e3a3b489e req-21ac2fef-7064-4b39-8332-8e7f6201fe2c service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:09.396287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-d24153bb-bcc0-4869-bd26-bc3e3a3b489e req-21ac2fef-7064-4b39-8332-8e7f6201fe2c service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:09.409202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-d24153bb-bcc0-4869-bd26-bc3e3a3b489e req-21ac2fef-7064-4b39-8332-8e7f6201fe2c service nova] Creating event network-vif-deleted:ac21a55c-508f-45cb-96cc-44152b7643dd for instance 84283f84-8793-4072-8e32-bfec2d2035f2 on hv-cinder-84690 Jun 21 06:00:09.415603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-d24153bb-bcc0-4869-bd26-bc3e3a3b489e req-21ac2fef-7064-4b39-8332-8e7f6201fe2c service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034955 Jun 21 06:00:09.416503 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 413/800] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:09.589268 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:09.590540 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:09.598411 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:09.598976 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:09.599755 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:09.600189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:09.608368 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:09.609865 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:09.617084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:09.617519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:09.618590 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:09.619160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:09.623483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:09.636113 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:09.637973 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:09.637973 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'fault' on Instance uuid 84283f84-8793-4072-8e32-bfec2d2035f2 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:00:09.708343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:09.719409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e1aa4bf3-4e56-433a-9e3e-0228533c93b9 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 200 len: 1333 microversion: 2.1 time: 0.134237 Jun 21 06:00:09.720283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 388/801] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:09 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 1333 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:09.785330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:09.793622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:09.795195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:09.796371 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-97fc610e-7464-4703-8eb6-08c92f6d1d6b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.192685 Jun 21 06:00:09.796951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 414/802] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:09 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:10.735844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:10.736393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 84283f84-8793-4072-8e32-bfec2d2035f2] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:10.742899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:10.743351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:10.744105 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:10.744537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:10.759808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] HTTP exception thrown: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 could not be found. Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Request method failure captured: Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 HTTP/1.1 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisVz_Z9TyzhytPasjjVgIW6mOwReV5vngrpMrqo-qW94z2uf63XGuiYeGQbP-gYx6kKffTX8IYYkxgpoWBTCyOGl1niXnbR9nZ0MIzx0r6sAqiLDnvjw4ILhCVFJZimgnZ-_iUJqShtj8viDr3XekjhhIYaBW2Tfjd4klvxi5FulnWX8 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:00:10.761442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f2d23615fd6349e1b70fdbad64b89b78 Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 could not be found. Jun 21 06:00:10.763042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '84283f84-8793-4072-8e32-bfec2d2035f2'} Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 could not be found. Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:00:10.764508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 could not be found. Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 could not be found. Jun 21 06:00:10.766000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:00:10.767279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Returning 404 to user: Instance 84283f84-8793-4072-8e32-bfec2d2035f2 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:00:10.767279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9ea5be98-b4f7-429e-859e-83fec5a9538b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2" status: 404 len: 111 microversion: 2.1 time: 0.030969 Jun 21 06:00:10.767279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 389/803] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:10 2022] GET /compute/v2.1/servers/84283f84-8793-4072-8e32-bfec2d2035f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:00:10.772098 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2ed7ccaf-b81b-46d2-b9ed-af81cfdf207b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '.version_select at 0x7efe5c63e0d0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:10.789564 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2ed7ccaf-b81b-46d2-b9ed-af81cfdf207b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-141764244" status: 202 len: 0 microversion: 2.1 time: 0.021322 Jun 21 06:00:10.790140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 415/804] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Jun 21 06:00:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-141764244 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:00:10.815130 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:10.815743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:10.821673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:10.822182 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:10.822950 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:10.823385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:10.989678 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:10.998642 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:11.000181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:11.001426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-97167199-3fe8-41ca-8d5f-3d4a46561d3e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.190648 Jun 21 06:00:11.001903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 390/805] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:10 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:12.020625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:12.021227 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:12.027758 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:12.028195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:12.028962 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:12.029370 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:12.161367 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:12.169257 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:12.170802 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:12.171947 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d5c0c735-0b32-494d-85e1-5d960c0ffa9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.155860 Jun 21 06:00:12.172534 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 416/806] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:12 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:13.189424 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:13.190001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:13.196514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:13.196962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:13.197731 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:13.198196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:13.335062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:13.343918 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:13.345418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:13.346617 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-056a574b-002f-4379-9dd2-bcc4783fcab6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.161225 Jun 21 06:00:13.347174 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 391/807] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:13 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:13.728002 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:13.728547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:13.735101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:13.735535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:13.736282 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:13.736705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:13.761824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:00:13.843728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-39abccbf-5a22-4575-93c1-1df7e84ef1f8 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 204 len: 0 microversion: 2.1 time: 0.118994 Jun 21 06:00:13.844411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 417/808] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:00:13 2022] DELETE /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:00:13.852509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:13.853155 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:13.859819 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:13.860267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:13.861038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:13.861477 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:13.991632 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:13.999214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cbdd4804-ee1f-4274-8293-f60a108fc1be tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1508 microversion: 2.1 time: 0.150615 Jun 21 06:00:13.999846 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 392/809] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:13 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:14.366764 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:14.367463 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:14.369383 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:14.374828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:14.375272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:14.376040 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:14.376469 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:14.515514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:14.523476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:14.524969 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:14.526142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-79e7835e-4715-4461-bd67-a9cee71653c1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.163659 Jun 21 06:00:14.526766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 418/810] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:14 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:15.016795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:15.017398 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:15.024030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:15.024476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:15.025245 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:15.025677 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:15.156964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:15.164890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0638d1b4-f6ae-4953-a8db-15839ad4d2a3 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1508 microversion: 2.1 time: 0.152470 Jun 21 06:00:15.165452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 393/811] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:15 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:15.544792 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:15.545411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:15.552189 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:15.552637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:15.553401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:15.553829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:15.696618 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:15.707211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:15.708746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:15.710652 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b7af7102-9aaa-41c4-89c9-a0853f83361a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1744 microversion: 2.20 time: 0.169827 Jun 21 06:00:15.711478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 419/812] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:15 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:15.773205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-f541c009-a46e-420a-9fa8-3ce1c88b4136 req-070e5289-e384-420a-95e7-18185118830b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aa48120-9328-4812-bcaa-9f731723b815", "name": "network-vif-deleted", "tag": "9e97f399-c2e0-4a28-b1f4-99873b2113ef"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:15.782582 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f541c009-a46e-420a-9fa8-3ce1c88b4136 req-070e5289-e384-420a-95e7-18185118830b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:15.783545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-f541c009-a46e-420a-9fa8-3ce1c88b4136 req-070e5289-e384-420a-95e7-18185118830b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:15.796785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-f541c009-a46e-420a-9fa8-3ce1c88b4136 req-070e5289-e384-420a-95e7-18185118830b service nova] Creating event network-vif-deleted:9e97f399-c2e0-4a28-b1f4-99873b2113ef for instance 4aa48120-9328-4812-bcaa-9f731723b815 on hv-cinder-84690 Jun 21 06:00:15.802113 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-f541c009-a46e-420a-9fa8-3ce1c88b4136 req-070e5289-e384-420a-95e7-18185118830b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 Jun 21 06:00:15.802956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 394/813] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:16.182170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:16.182793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:16.189764 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:16.190253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:16.191030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:16.191466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:16.226396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:16.226850 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:16.227353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'fault' on Instance uuid 4aa48120-9328-4812-bcaa-9f731723b815 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:00:16.270121 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:16.278658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0b3244f0-d531-4aad-ac28-afa316160d4e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 200 len: 1311 microversion: 2.1 time: 0.100490 Jun 21 06:00:16.279913 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 420/814] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:16 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:16.730186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:16.730889 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:16.737997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:16.738455 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:16.739235 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:16.739667 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:16.876516 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:16.884754 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:16.886276 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:16.887525 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-75780415-dd2a-42cd-80ef-2b35c1182c42 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1744 microversion: 2.20 time: 0.161602 Jun 21 06:00:16.888094 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 395/815] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:16 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:17.296685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:17.297406 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 4aa48120-9328-4812-bcaa-9f731723b815] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:17.304138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.304586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.305446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.305986 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.321700 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] HTTP exception thrown: Instance 4aa48120-9328-4812-bcaa-9f731723b815 could not be found. Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Request method failure captured: Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 HTTP/1.1 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisVz_Z9TyzhytPasjjVgIW6mOwReV5vngrpMrqo-qW94z2uf63XGuiYeGQbP-gYx6kKffTX8IYYkxgpoWBTCyOGl1niXnbR9nZ0MIzx0r6sAqiLDnvjw4ILhCVFJZimgnZ-_iUJqShtj8viDr3XekjhhIYaBW2Tfjd4klvxi5FulnWX8 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:00:17.323385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f2d23615fd6349e1b70fdbad64b89b78 Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 4aa48120-9328-4812-bcaa-9f731723b815 could not be found. Jun 21 06:00:17.324945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '4aa48120-9328-4812-bcaa-9f731723b815'} Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aa48120-9328-4812-bcaa-9f731723b815 could not be found. Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:00:17.325813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aa48120-9328-4812-bcaa-9f731723b815 could not be found. Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aa48120-9328-4812-bcaa-9f731723b815 could not be found. Jun 21 06:00:17.327263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:17.328405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Returning 404 to user: Instance 4aa48120-9328-4812-bcaa-9f731723b815 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:00:17.328405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-efd0931b-eb35-4538-950e-99f651d78da2 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815" status: 404 len: 111 microversion: 2.1 time: 0.032539 Jun 21 06:00:17.328405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 421/816] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:17 2022] GET /compute/v2.1/servers/4aa48120-9328-4812-bcaa-9f731723b815 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:00:17.333918 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:17.334430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:17.340452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.341155 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.344062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.344499 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.370588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:00:17.445305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-34d6879a-0b44-433b-9978-466b832308a7 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "DELETE /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 204 len: 0 microversion: 2.1 time: 0.114879 Jun 21 06:00:17.445910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 396/817] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:00:17 2022] DELETE /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:00:17.453964 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:17.454600 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:17.460700 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.461158 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.461959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.462387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.597186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:17.604810 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6e76d9fa-18b5-4dff-b5e7-173dbf5f1f6d tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.154665 Jun 21 06:00:17.605410 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 422/818] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:17 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:17.909471 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:17.910206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:17.916868 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.917314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:17.918129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:17.918590 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:18.052043 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:18.060309 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:18.061790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:18.062997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9d5cc854-cdd0-4e79-a1c2-046bba406f64 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1744 microversion: 2.20 time: 0.157912 Jun 21 06:00:18.063548 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 397/819] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:17 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:18.623678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:18.624423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:18.631147 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:18.631585 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:18.632579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:18.633009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:18.770177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:18.778948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c129835e-e0df-4056-806e-b033d5189022 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.159744 Jun 21 06:00:18.779543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 423/820] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:18 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:18.931800 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-e6118293-0a75-4576-b976-810123fbf336 req-39cc1a2a-c4bc-4b13-9e08-f0d5ae06188f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "name": "network-vif-plugged", "status": "completed", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:18.940753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-e6118293-0a75-4576-b976-810123fbf336 req-39cc1a2a-c4bc-4b13-9e08-f0d5ae06188f service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:18.941295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-e6118293-0a75-4576-b976-810123fbf336 req-39cc1a2a-c4bc-4b13-9e08-f0d5ae06188f service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:18.953133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-e6118293-0a75-4576-b976-810123fbf336 req-39cc1a2a-c4bc-4b13-9e08-f0d5ae06188f service nova] Creating event network-vif-plugged:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 06:00:18.958464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-e6118293-0a75-4576-b976-810123fbf336 req-39cc1a2a-c4bc-4b13-9e08-f0d5ae06188f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087421 Jun 21 06:00:18.959248 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 398/821] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:19.083164 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:19.083782 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:19.090207 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:19.090654 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:19.092188 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:19.092642 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:19.222338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:19.230319 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:19.231844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:19.233590 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-897be79c-df10-4ce5-b8cc-d1d06df06a40 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1744 microversion: 2.20 time: 0.154450 Jun 21 06:00:19.234181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 424/822] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:19 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:19.796488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:19.797202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:19.803629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:19.804068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:19.804824 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:19.805246 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:19.936449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:19.944384 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-41ea1156-58f3-4de0-b55b-64167a12dd75 tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1521 microversion: 2.1 time: 0.152150 Jun 21 06:00:19.944978 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 399/823] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:19 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:20.252525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:20.253122 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:20.259964 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:20.260453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:20.261178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:20.261609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:20.413215 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:20.423515 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:20.425347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:20.426634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f839034c-fd12-43d9-a6b7-2b2f83db4575 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.178747 Jun 21 06:00:20.427188 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 425/824] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:20 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:20.642658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-0de71c00-23f8-419b-8faf-e1f46522a655 req-4c6965e4-d1d6-4df9-a0e1-2ae88c73f9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68510b32-92ff-4e8b-9c40-00a56f652c61", "name": "network-vif-deleted", "tag": "e166dd5d-be6c-42ae-ab3a-1615b941b157"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:20.646732 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:20.653382 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-0de71c00-23f8-419b-8faf-e1f46522a655 req-4c6965e4-d1d6-4df9-a0e1-2ae88c73f9d8 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:20.654708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-0de71c00-23f8-419b-8faf-e1f46522a655 req-4c6965e4-d1d6-4df9-a0e1-2ae88c73f9d8 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:20.670175 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-0de71c00-23f8-419b-8faf-e1f46522a655 req-4c6965e4-d1d6-4df9-a0e1-2ae88c73f9d8 service nova] Creating event network-vif-deleted:e166dd5d-be6c-42ae-ab3a-1615b941b157 for instance 68510b32-92ff-4e8b-9c40-00a56f652c61 on hv-cinder-84690 Jun 21 06:00:20.676608 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-0de71c00-23f8-419b-8faf-e1f46522a655 req-4c6965e4-d1d6-4df9-a0e1-2ae88c73f9d8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038548 Jun 21 06:00:20.677631 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 400/825] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:20.964377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:20.967253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:20.986027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:20.986902 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:20.988046 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:20.988731 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:21.039628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:21.040329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:21.040946 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lazy-loading 'fault' on Instance uuid 68510b32-92ff-4e8b-9c40-00a56f652c61 {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:00:21.128397 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d23615fd6349e1b70fdbad64b89b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7050c81c7efe4c0199573adc5687e9c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:21.142267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-32586836-be45-47ba-8666-a85d4ad1e14e tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 200 len: 1311 microversion: 2.1 time: 0.182523 Jun 21 06:00:21.143140 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 426/826] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:20 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:21.447178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:21.448533 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:21.459214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:21.459938 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:21.460741 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:21.461892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:21.629131 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:21.639148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:21.640912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:21.642120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d5e7e714-e5ad-4e7a-a4f4-a2a88cee0e2f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.200184 Jun 21 06:00:21.643034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 401/827] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:21 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:22.160260 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:22.161290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] [instance: 68510b32-92ff-4e8b-9c40-00a56f652c61] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:22.168420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:22.168985 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:22.170078 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:22.171051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:22.187014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] HTTP exception thrown: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 could not be found. Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Request method failure captured: Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 HTTP/1.1 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisVz_Z9TyzhytPasjjVgIW6mOwReV5vngrpMrqo-qW94z2uf63XGuiYeGQbP-gYx6kKffTX8IYYkxgpoWBTCyOGl1niXnbR9nZ0MIzx0r6sAqiLDnvjw4ILhCVFJZimgnZ-_iUJqShtj8viDr3XekjhhIYaBW2Tfjd4klvxi5FulnWX8 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:00:22.188853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7050c81c7efe4c0199573adc5687e9c0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 7050c81c7efe4c0199573adc5687e9c0 Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1520546684 Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f2d23615fd6349e1b70fdbad64b89b78 Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1520546684-project Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 could not be found. Jun 21 06:00:22.190525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '68510b32-92ff-4e8b-9c40-00a56f652c61'} Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 could not be found. Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:00:22.191495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 could not be found. Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 could not be found. Jun 21 06:00:22.192980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:00:22.197828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] Returning 404 to user: Instance 68510b32-92ff-4e8b-9c40-00a56f652c61 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:00:22.197828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bdc2c3f4-8789-4cfb-8664-532bf0acb43b tempest-ServerRescueNegativeTestJSON-1520546684 tempest-ServerRescueNegativeTestJSON-1520546684-project] 10.222.0.18 "GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61" status: 404 len: 111 microversion: 2.1 time: 0.033881 Jun 21 06:00:22.197828 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 427/828] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:22 2022] GET /compute/v2.1/servers/68510b32-92ff-4e8b-9c40-00a56f652c61 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:00:22.665135 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:22.666389 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:22.676064 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:22.676773 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:22.677727 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:22.678187 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:22.695660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:22.921505 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:22.949656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:22.953019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:22.963808 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1943e866-89c3-4ea7-9bac-05b24bd59424 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.293395 Jun 21 06:00:22.965381 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 402/829] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:22 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:23.986065 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:23.986684 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:24.002323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:24.011504 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:24.016538 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:24.017596 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:24.293174 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:24.305152 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:24.306721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:24.307912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3dbfcfe4-87c5-46cf-b7f1-87ea2db2ba29 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.327046 Jun 21 06:00:24.323297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 428/830] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:23 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:25.338443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:25.339173 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:25.351843 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:25.359512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:25.360410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:25.360866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:25.549688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:25.557820 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:25.559351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:25.560751 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f117ea6a-31c1-48ef-a011-b88ba37df3d1 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.227046 Jun 21 06:00:25.561680 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 403/831] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:25 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:26.587357 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:26.588959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:26.598220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:26.598676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:26.599439 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:26.599868 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:26.772863 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:26.782842 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:26.784453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:26.785722 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-863498ce-0e93-4d1a-9d2f-46b51c243877 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.202933 Jun 21 06:00:26.790459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 429/832] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:26 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:27.813954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:27.813954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:27.820469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:27.821216 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:27.822388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:27.822926 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:27.996952 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:28.021304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:28.022834 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:28.023999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e754ac4e-3c27-46b4-ad76-c18e9042d6a8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.223209 Jun 21 06:00:28.040206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 404/833] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:27 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:29.048101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:29.049509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:29.056510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.056976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.057807 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.058486 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.284968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:29.289042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:29.297375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:29.299076 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:29.300356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2f33f3f4-6e43-4e93-8fbf-fa58daa3c38d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.260989 Jun 21 06:00:29.300934 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 430/834] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:29 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:29.345554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:29.346200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:29.353409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.353972 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.354842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.355374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.382231 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-97d20dfa-71cb-4e99-8fdd-60a183cf57e8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/ips" status: 200 len: 145 microversion: 2.1 time: 0.040443 Jun 21 06:00:29.383203 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 405/835] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 06:00:29 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:29.842682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:29.842682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:29.850092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.850809 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.851829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.852396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.878279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lazy-loading 'flavor' on Instance uuid 637283de-f095-41ed-97d1-0270fd8adb7e {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:00:29.962832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c171329b-3df3-4cb0-8cb9-a25ced7dbecd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "POST /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e/action" status: 202 len: 0 microversion: 2.1 time: 0.128979 Jun 21 06:00:29.963551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 431/836] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 06:00:29 2022] POST /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:00:29.975320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:29.976088 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:29.982680 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.983319 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:29.984252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:29.984757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:30.170137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:30.179873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b4787563-5cf1-4a0e-8474-d2aa3a1b732c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.209610 Jun 21 06:00:30.180445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 406/837] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:29 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:30.319801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:30.320490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:30.328117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:30.328554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:30.329309 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:30.329735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:30.471202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:30.480912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:30.482621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:30.483839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5355e624-a12a-4de1-943a-21c11d23d293 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1739 microversion: 2.20 time: 0.168898 Jun 21 06:00:30.485120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 432/838] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:30 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:30.786289 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27efda2d-ff6b-4282-87b5-181a9c044d35"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:30.787401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:30.794420 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:30.794844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:30.795603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:30.796041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:31.068867 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f048033b-ef02-445e-8cbf-56d0c1a5d2c7 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286408 Jun 21 06:00:31.073118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 407/839] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 06:00:30 2022] POST /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:31.196577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:31.197187 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:31.204942 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:31.205392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:31.206688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:31.207332 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:31.364634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:31.374438 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-28f4c286-ddf7-4461-8f90-71367722cfab tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.181233 Jun 21 06:00:31.375049 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 433/840] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:31 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:31.504544 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:31.505215 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:31.513247 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:31.513697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:31.514529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:31.514956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:31.660555 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:31.668925 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:31.670473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:31.671634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5e7dbcb1-32e4-4a38-b836-32c864fd0b2a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1721 microversion: 2.20 time: 0.172137 Jun 21 06:00:31.672191 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 408/841] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:31 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:32.394755 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:32.395286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:32.402279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:32.402958 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:32.403822 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:32.404259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:32.536584 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:32.544571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ba483485-bdb3-4e98-afef-12cdaf8ec917 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.153328 Jun 21 06:00:32.545143 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 434/842] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:32 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:32.690148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:32.690686 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:32.697219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:32.697653 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:32.698433 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:32.698860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:32.830963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:32.839299 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:32.841568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:32.842768 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a0076308-34aa-440c-9d20-492b2e0d1c62 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1721 microversion: 2.20 time: 0.156682 Jun 21 06:00:32.843327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 409/843] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:32 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:33.562585 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:33.563121 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:33.569512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:33.569970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:33.570732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:33.571162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:33.702202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:33.710002 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2fb4679a-5dfb-4e75-b934-b3bef4d1d6ea tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.151971 Jun 21 06:00:33.710570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 435/844] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:33 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:33.862033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:33.862638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:33.869056 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:33.869504 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:33.870297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:33.870725 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:34.000214 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:34.008180 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:34.009668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:34.011049 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d090016f-1a4f-4f5e-b83d-38399b18878b tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1721 microversion: 2.20 time: 0.153004 Jun 21 06:00:34.011600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 410/845] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:33 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:34.727789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:34.728199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:34.734959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:34.735405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:34.736177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:34.736614 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:34.847831 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-42342106-805b-4850-8c3e-772bb52346ca req-9d4784ff-e0b3-43b3-b4e9-5a4cca0a1c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "name": "network-vif-unplugged", "status": "completed", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:34.857683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-42342106-805b-4850-8c3e-772bb52346ca req-9d4784ff-e0b3-43b3-b4e9-5a4cca0a1c0f service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:34.858170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-42342106-805b-4850-8c3e-772bb52346ca req-9d4784ff-e0b3-43b3-b4e9-5a4cca0a1c0f service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:34.871156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-42342106-805b-4850-8c3e-772bb52346ca req-9d4784ff-e0b3-43b3-b4e9-5a4cca0a1c0f service nova] Creating event network-vif-unplugged:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 06:00:34.877414 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-42342106-805b-4850-8c3e-772bb52346ca req-9d4784ff-e0b3-43b3-b4e9-5a4cca0a1c0f service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033450 Jun 21 06:00:34.878489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 411/846] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:34.879026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:34.887644 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-38498f1e-3d90-4abe-b319-0f19eb201485 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.164023 Jun 21 06:00:34.888586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 436/847] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:34 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:35.030359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:35.031072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:35.038122 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.038596 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.039371 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.039803 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.184861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:35.193321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:35.194929 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:35.196097 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bcb6830b-c27a-4a18-8d5b-b1cf6470a163 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1724 microversion: 2.20 time: 0.171123 Jun 21 06:00:35.196657 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 412/848] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:35 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:35.218825 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb75250f-75eb-4454-a205-df32fc8382cd"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:35.219981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:35.226176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.226628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.227404 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.227842 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.583114 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-314aa38f-e26e-4199-b4d2-050f6dc3ef9e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.371211 Jun 21 06:00:35.583737 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 437/849] 10.222.0.18 () {62 vars in 1363 bytes} [Tue Jun 21 06:00:35 2022] POST /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-volume_attachments => generated 188 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 21 06:00:35.697677 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:35.698207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:35.704757 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.705206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.705997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.706438 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.905435 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:35.906107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:35.913650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.914130 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.914996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.915415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.927798 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f5c81cbc-3844-49eb-8ebd-0fc9a69de0c9 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-volume_attachments/bb75250f-75eb-4454-a205-df32fc8382cd" status: 202 len: 0 microversion: 2.20 time: 0.233971 Jun 21 06:00:35.928737 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 413/850] 10.222.0.18 () {60 vars in 1456 bytes} [Tue Jun 21 06:00:35 2022] DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-volume_attachments/bb75250f-75eb-4454-a205-df32fc8382cd => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:00:35.986217 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:35.986866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:35.993551 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.994043 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:35.995028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:35.995462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:36.054041 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:36.061586 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7b0ef236-0063-4493-8f66-19b37afa62ff tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.160507 Jun 21 06:00:36.062186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 438/851] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:35 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:00:36.095265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-431a8de7-0e76-4ed5-9249-54dc5804ac76 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "POST /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/action" status: 202 len: 0 microversion: 2.20 time: 0.113051 Jun 21 06:00:36.095867 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 414/852] 10.222.0.18 () {62 vars in 1318 bytes} [Tue Jun 21 06:00:35 2022] POST /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:00:36.106543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:36.107609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:36.114915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:36.115267 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:36.116035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:36.116465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:36.256721 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:36.265415 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:36.267063 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:36.268396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-756cf322-7a58-4676-9d83-4d23ecbf3269 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1672 microversion: 2.20 time: 0.165823 Jun 21 06:00:36.269016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 439/853] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:36 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:37.084207 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:37.085295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:37.094629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:37.095104 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:37.096269 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:37.097117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:37.104742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:37.249812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:37.257474 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ae8f7725-df1c-4ac9-8750-baaadfd8e4f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.181350 Jun 21 06:00:37.258117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 415/854] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:37 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:37.287450 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:37.288280 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:37.296661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:37.297202 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:37.298103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:37.298545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:37.432924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:37.441104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:37.442639 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:37.443799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-304af62c-bbe9-46ff-8ecb-814e7954b428 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.160379 Jun 21 06:00:37.444364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 440/855] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:37 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:38.275630 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:38.277075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:38.284487 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:38.284929 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:38.285692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:38.286181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:38.427033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:38.436000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3779f58c-4a10-489f-8962-1866370faf3c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.163933 Jun 21 06:00:38.436208 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 416/856] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:38 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:38.462489 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:38.463726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:38.472027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:38.472681 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:38.473792 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:38.474429 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:38.650693 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:38.671574 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:38.673134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:38.674578 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c19e4709-7000-49a5-9706-85df1ff2b161 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.215743 Jun 21 06:00:38.675077 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 441/857] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:38 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:39.454621 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:39.456041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:39.463624 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:39.464062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:39.465079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:39.474794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:39.695742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:39.697579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:39.705821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:39.706619 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:39.707759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:39.708392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:40.023204 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:40.031671 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f9cf87b7-7617-447c-a7e6-902fa6de9d3e tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.582613 Jun 21 06:00:40.034018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 417/858] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:39 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:00:40.091477 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:40.095458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:40.102799 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:40.104875 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:40.106205 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-640a81f1-afca-475b-b469-ef83c378e14a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.416234 Jun 21 06:00:40.106982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 442/859] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:39 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:41.057802 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:41.059835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:41.067483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:41.068280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:41.069430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:41.070120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:41.124459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:41.125817 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:41.143523 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:41.144314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:41.146419 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:41.147173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:41.325443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:41.334405 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-741c6fdb-58bf-4ef2-a449-c0c4c901f2a3 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.282426 Jun 21 06:00:41.335031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 418/860] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:41 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:41.364517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:41.375497 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:41.378763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:41.380414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e04859c0-6402-4cf0-ad1a-d7a07678721f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.260717 Jun 21 06:00:41.381577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 443/861] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:41 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:42.101420 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:42.101986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:42.113699 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:42.114184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:42.115468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:42.115468 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:42.172255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-953af90b-366d-4460-9930-e54e4fead106 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/ips" status: 200 len: 150 microversion: 2.1 time: 0.074768 Jun 21 06:00:42.172942 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 419/862] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 06:00:42 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/ips => generated 150 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:42.352493 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:42.353113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:42.363348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:42.364638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:42.366397 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:42.367513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:42.407886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:42.409706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:42.420265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:42.420717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:42.422042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:42.423306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:42.718824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:42.738387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8fdf223c-867f-430a-adf3-dff05e738ebc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.384032 Jun 21 06:00:42.739376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 444/863] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:42 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:42.826401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:42.842125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:42.842679 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:42.844320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2c1b01ec-6e91-4cef-9e42-a9d4618233f8 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.443379 Jun 21 06:00:42.845211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 420/864] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:42 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:43.701540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27375e1b-4060-4588-a55c-82ad14c12206"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:43.703281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:43.714526 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:43.716351 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:43.717528 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:43.718435 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:43.758108 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:43.758921 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:43.770655 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:43.771571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:43.772665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:43.773887 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:44.010495 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:44.020789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e7fed772-77c0-4a0f-b0b7-8b2b646dca06 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.267700 Jun 21 06:00:44.021552 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 421/865] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:43 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:00:44.035476 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:44.036554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:44.044065 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:44.044944 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:44.046084 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:44.046756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:44.244524 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:44.262749 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:44.264820 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:44.266272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1812b90a-c6eb-4c55-83d3-da2c2a809924 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.243666 Jun 21 06:00:44.268828 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 422/866] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:44 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:45.042529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:45.043498 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:45.049737 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:45.050233 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:45.051002 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:45.051541 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:45.239538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:45.250449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-471388ee-ad0d-42b7-8276-2aa83863a221 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.211809 Jun 21 06:00:45.251276 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 423/867] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:45 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:00:45.292000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:45.292616 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:45.301421 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:45.301875 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:45.302700 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:45.303141 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:45.481836 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:45.492348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:45.495082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:45.497157 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7871f75a-0c0f-4ad5-b54e-ea2d86fc361f tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.209215 Jun 21 06:00:45.499828 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 424/868] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:45 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:46.270578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:46.271352 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:46.279065 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:46.279681 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:46.280736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:46.281348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:46.431473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:46.443229 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-542a4135-2229-4208-8f02-e6bf8ea17dd0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.176989 Jun 21 06:00:46.443812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 425/869] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:46 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:00:46.518600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:46.519302 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:46.525669 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:46.526161 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:46.526954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:46.527975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:46.697995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:46.711401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:46.712931 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:46.714388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7d657b87-850b-4023-9ef0-871b0f941a3d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.199628 Jun 21 06:00:46.715616 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 426/870] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:46 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:47.461047 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:47.461810 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:47.468872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:47.469304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:47.470120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:47.470561 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:47.606957 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:47.614648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-fc2ec098-170c-4a93-b608-b05269a97816 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.157787 Jun 21 06:00:47.615224 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 427/871] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:47 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:00:47.733140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:47.733753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:47.740005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:47.740717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:47.741502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:47.741954 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:47.884308 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:47.899323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:47.901163 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:47.902899 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7bbcf28b-3fb0-471c-b32f-044edf434aff tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.173727 Jun 21 06:00:47.903449 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 428/872] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:47 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:48.177193 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1f7b12cc-f501-4c2f-b0a5-9af39db695de tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "POST /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.480440 Jun 21 06:00:48.178148 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 445/873] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 06:00:43 2022] POST /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 194 bytes in 4482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:48.631331 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:48.632133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:48.641698 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:48.642335 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:48.643116 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:48.643558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:48.796014 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:48.814007 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-32621a3d-434f-4754-b4fb-562f86c222be tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.181034 Jun 21 06:00:48.815297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 429/874] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:48 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:48.922427 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:48.923110 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:48.925071 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=60 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:48.931456 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:48.931899 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:48.932666 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:48.933092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:49.129173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:49.138173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:49.139676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:49.140839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fe4fcba3-e875-42a9-afaa-e09ed0c52d32 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.223716 Jun 21 06:00:49.141398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 446/875] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:48 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:49.481377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:49.483825 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:49.495436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:49.496395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:49.497852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:49.498761 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:49.557653 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9bd44aa2-4528-495c-9c40-3a5e47a274bf tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083843 Jun 21 06:00:49.558260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 430/876] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:00:49 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:49.568555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:49.569298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:49.576631 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:49.577359 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:49.578167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:49.578600 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:49.609939 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-330779b4-90e9-4688-8bd1-76a7183ff251 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/27efda2d-ff6b-4282-87b5-181a9c044d35" status: 200 len: 194 microversion: 2.1 time: 0.045413 Jun 21 06:00:49.610879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 447/877] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Jun 21 06:00:49 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/27efda2d-ff6b-4282-87b5-181a9c044d35 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:49.832139 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:49.833448 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:49.844774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:49.845224 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:49.846260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:49.847399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:50.022076 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:50.030393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7f46ebad-bdba-445d-97a9-fe4b17b65b8c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.202662 Jun 21 06:00:50.031554 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 431/878] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:49 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:50.159790 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:50.160489 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:50.167303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:50.168381 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:50.169216 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:50.169720 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:50.316129 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:50.326900 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:50.328530 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:50.330134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-47f47a75-c002-4dff-92b6-f0a6258808e0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.174072 Jun 21 06:00:50.330534 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 448/879] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:50 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:51.061439 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e7dce98-53ca-47e5-babf-e1f33fd5f198"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:51.066239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:51.067043 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:51.070708 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:51.071000 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=66 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:51.081401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:51.082201 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:51.083096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:51.083361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:51.083837 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:51.084155 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:51.084827 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:51.085395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:51.093183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:51.267688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:51.279016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-804cc54b-f28e-45d8-9820-946ed2f7bb9f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.234378 Jun 21 06:00:51.279747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 432/880] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:51 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:51.348381 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:51.349274 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:51.357800 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:51.358302 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:51.359078 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:51.366977 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:51.555299 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a73f4fa7-8ef8-4339-988e-955510c00da6 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "POST /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497989 Jun 21 06:00:51.559334 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 449/881] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 06:00:51 2022] POST /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:51.580751 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:51.607021 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:51.608767 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:51.610102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1a0827f0-2856-46a8-810b-6e2d8887f79c tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.265550 Jun 21 06:00:51.610654 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 433/882] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:51 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:52.298416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:52.299025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:52.305211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.305650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.306426 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.306853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.442129 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:52.450214 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dddd4b3e-1c07-449e-896c-6d07510f60d0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1508 microversion: 2.1 time: 0.157479 Jun 21 06:00:52.450780 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 450/883] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:52 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:52.467324 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:52.467878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:52.474537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.474975 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.475721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.476153 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.550584 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-85abf461-448a-4e92-8a3c-84a87ecb26ec tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "POST /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e/action" status: 202 len: 0 microversion: 2.1 time: 0.088046 Jun 21 06:00:52.551205 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 434/884] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 06:00:52 2022] POST /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:00:52.559517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:52.560170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:52.566360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.566801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.567560 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.567984 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.629795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:52.630438 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:52.637604 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.638193 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.639031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.639566 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:52.792692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:52.802387 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5781363b-43bf-4659-b1e7-3a6d4217d2bc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1516 microversion: 2.1 time: 0.246426 Jun 21 06:00:52.803735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 451/885] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:52 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:52.824410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:52.837091 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:52.839260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:52.841259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0695df48-7eef-4e08-b734-ea355f9de344 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.215965 Jun 21 06:00:52.846419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 435/886] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:52 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:00:52.973977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-9b5ae9ab-4af2-4c4b-b8e6-6bd1b587a5d3 req-d876bc3f-3345-4547-bef3-8e383fa62454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "name": "network-vif-plugged", "status": "completed", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:52.988710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-9b5ae9ab-4af2-4c4b-b8e6-6bd1b587a5d3 req-d876bc3f-3345-4547-bef3-8e383fa62454 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:52.989291 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-9b5ae9ab-4af2-4c4b-b8e6-6bd1b587a5d3 req-d876bc3f-3345-4547-bef3-8e383fa62454 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:53.164659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-9b5ae9ab-4af2-4c4b-b8e6-6bd1b587a5d3 req-d876bc3f-3345-4547-bef3-8e383fa62454 service nova] Creating event network-vif-plugged:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 06:00:53.170298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-9b5ae9ab-4af2-4c4b-b8e6-6bd1b587a5d3 req-d876bc3f-3345-4547-bef3-8e383fa62454 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201671 Jun 21 06:00:53.171243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 452/887] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:53.820758 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:53.821363 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:53.827898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:53.828343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:53.829105 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:53.830370 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:53.860737 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:53.861416 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:53.867646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:53.868080 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:53.868829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:53.869252 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:54.019180 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:54.028581 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6770c467-f1a3-4584-89ef-542c3b6f99cd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.211522 Jun 21 06:00:54.029309 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 436/888] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:53 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:54.046100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:54.053970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:54.055476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:54.056624 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-21353762-8088-4ea0-bea5-160ee6ec5296 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.200056 Jun 21 06:00:54.057165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 453/889] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:53 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:55.046589 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:55.047190 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:55.054030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:55.054471 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:55.055235 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:55.055664 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:55.075618 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:55.077227 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:55.084136 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:55.084676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:55.085532 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:55.086086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:55.248201 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:55.257759 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7c12d7a9-88ef-4f5b-8c68-e61ad45de02f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.214733 Jun 21 06:00:55.259376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 437/890] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:55 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:55.274223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-a92b158b-bc90-4dc0-985d-f04e8b2a95d6 req-5e5c5814-e3ff-4deb-a3cc-3d98c7667115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "name": "network-vif-unplugged", "status": "completed", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:00:55.279494 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:55.283119 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-a92b158b-bc90-4dc0-985d-f04e8b2a95d6 req-5e5c5814-e3ff-4deb-a3cc-3d98c7667115 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:55.284125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-a92b158b-bc90-4dc0-985d-f04e8b2a95d6 req-5e5c5814-e3ff-4deb-a3cc-3d98c7667115 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:55.289306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:55.291447 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:55.293272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-779e71bb-2ec1-47ce-857b-243048ffaea6 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1730 microversion: 2.20 time: 0.222069 Jun 21 06:00:55.294016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 454/891] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:55 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:55.295651 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.compute.server_external_events [req-a92b158b-bc90-4dc0-985d-f04e8b2a95d6 req-5e5c5814-e3ff-4deb-a3cc-3d98c7667115 service nova] Unable to find a host for instance 637283de-f095-41ed-97d1-0270fd8adb7e. Dropping event network-vif-unplugged {{(pid=117430) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 21 06:00:55.296545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-a92b158b-bc90-4dc0-985d-f04e8b2a95d6 req-5e5c5814-e3ff-4deb-a3cc-3d98c7667115 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035954 Jun 21 06:00:55.297121 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 438/892] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 21 06:00:56.277489 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:56.278109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:56.284752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:56.285230 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:56.286104 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:56.286497 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:56.311841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:56.312524 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:56.319512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:56.319951 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:56.320788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:56.321272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:56.495317 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:56.506398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0308fd6c-adf0-4441-8701-7042f528c66f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.233476 Jun 21 06:00:56.507182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 455/893] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:56 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:56.529915 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:56.538871 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:56.540638 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:56.542130 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-2c08f2b3-fe80-4030-871f-c1a0f8e01511 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1717 microversion: 2.20 time: 0.234775 Jun 21 06:00:56.556446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 439/894] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:00:56 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1717 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:00:57.150693 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:57.151195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:57.157973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:57.158772 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:57.159466 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:57.159931 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:57.246928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'services' on Instance uuid 5a0106c2-482c-45bf-9b59-c362ffa6ba8c {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:00:57.324251 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:00:57.338011 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dcfd941a-da20-4137-b481-8a5101357c2c tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments/27375e1b-4060-4588-a55c-82ad14c12206" status: 202 len: 0 microversion: 2.1 time: 0.190982 Jun 21 06:00:57.338783 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 456/895] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 06:00:57 2022] DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments/27375e1b-4060-4588-a55c-82ad14c12206 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:00:57.347115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:57.348029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:57.361658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:57.362268 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:57.363061 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:57.363493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:57.397029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-37aa71c5-2268-43ca-bc59-3b7ef3dcce55 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053679 Jun 21 06:00:57.398096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 440/896] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:00:57 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:57.524717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:57.525442 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:57.533051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:57.533488 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:57.534274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:57.534701 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:57.672014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:57.679563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1f366882-a50a-4a7d-aea7-6028edd0f0ca tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.159270 Jun 21 06:00:57.680122 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 457/897] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:57 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:58.409030 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:58.410059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:58.416531 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:58.416971 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:58.418353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:58.418782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:58.450689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-29e1b279-2bfb-4798-b75c-bf19e5f6f436 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Jun 21 06:00:58.451366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 441/898] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:00:58 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:58.697270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:58.697924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:58.705010 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:58.705455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:58.706247 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:58.706705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:58.843905 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:00:58.851465 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f8de019d-6641-414a-b6a3-b7fa9ef5ca60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.158223 Jun 21 06:00:58.852020 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 458/899] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:58 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:00:59.463025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:59.463941 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:59.470728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:59.471171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:59.471934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:59.472368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:59.501978 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bc6d6cca-2811-41e2-a173-d4d3a0b253a0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Jun 21 06:00:59.502557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 442/900] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:00:59 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:00:59.869031 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:00:59.869710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:00:59.876990 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:59.877511 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:00:59.878541 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:00:59.879067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:00.032230 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:00.040432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f232524e-26e5-4e1b-ae18-17daea79b1f1 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.175436 Jun 21 06:01:00.041138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 459/901] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:00:59 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:00.513801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:00.514781 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:00.521304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:00.521702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:00.522485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:00.522909 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:00.551996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-16d84214-fd09-4edb-8c2c-615da9b9cb43 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jun 21 06:01:00.552549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 443/902] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:00 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:01.057647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:01.059055 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:01.065744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:01.066296 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:01.067131 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:01.067689 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:01.210117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:01.218737 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a5becf28-b337-47a7-bc9d-23568bceb0c5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.164929 Jun 21 06:01:01.219298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 460/903] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:01 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:01.563270 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:01.564090 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:01.573971 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:01.574691 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:01.575917 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:01.576613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:01.629815 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cc39f176-715b-4432-aa7a-ddcad743adcb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070099 Jun 21 06:01:01.631077 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 444/904] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:01 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:02.236094 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:02.236751 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:02.243249 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:02.243690 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:02.244451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:02.244877 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:02.399541 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:02.407875 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a0f19d50-8c75-427c-8448-ef4a04b5ca47 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.175575 Jun 21 06:01:02.408774 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 461/905] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:02 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:02.644955 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:02.645878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:02.652898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:02.653348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:02.654146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:02.654583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:02.683774 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e3ca56b1-cec8-4ed6-b207-9f4e5f4f38bd tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042840 Jun 21 06:01:02.684330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 445/906] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:02 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:03.404441 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:03.405561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:03.411902 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.412348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.413107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.413610 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.425463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:03.426429 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:03.435121 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.435701 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.436580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.437106 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.446703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-d91b8e69-9610-430a-a836-370eeb00f31e tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046223 Jun 21 06:01:03.447629 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 462/907] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:03 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:03.580675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:03.586893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:03.587370 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:03.589999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-00ec8996-20b8-4f2c-a973-1f9584ba95ef tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1518 microversion: 2.1 time: 0.168789 Jun 21 06:01:03.590668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 446/908] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:03 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:03.595908 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.596362 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.597160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.597594 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.627414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fbf0b657-971e-4a30-a3e5-4143e1815c63 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/27efda2d-ff6b-4282-87b5-181a9c044d35" status: 200 len: 194 microversion: 2.1 time: 0.044425 Jun 21 06:01:03.632602 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 463/909] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Jun 21 06:01:03 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/27efda2d-ff6b-4282-87b5-181a9c044d35 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:01:03.639286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:03.639777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:03.645709 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.646339 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.646912 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.647339 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.695569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:03.696817 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:03.703724 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.704171 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.704956 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:03.705390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:03.741752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4e0bb330-c44c-4c56-800e-3efa898b14c0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050295 Jun 21 06:01:03.745684 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 464/910] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:03 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:03.758529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lazy-loading 'services' on Instance uuid 919fe9b8-52bd-465b-ac3f-bd338e6afade {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:01:03.831457 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:03.851509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0b783422-4909-4341-803a-78b239ca2af9 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/27efda2d-ff6b-4282-87b5-181a9c044d35" status: 202 len: 0 microversion: 2.1 time: 0.216993 Jun 21 06:01:03.852859 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 447/911] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 06:01:03 2022] DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/27efda2d-ff6b-4282-87b5-181a9c044d35 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:01:04.607193 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:04.607789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:04.614579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:04.615014 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:04.615768 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:04.616191 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:04.753491 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:04.754615 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:04.759184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:04.761894 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1c232854-6cd9-4fa4-90d7-dfd47da8962f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.158470 Jun 21 06:01:04.762834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 465/912] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:04 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:04.763713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:04.764172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:04.764953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:04.765389 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:04.795635 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-825990dd-2886-4876-a26d-7637cdd27f5f tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046466 Jun 21 06:01:04.796193 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 448/913] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:04 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 21 06:01:04.853496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:04.854006 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:04.860020 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:04.860455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:04.861212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:04.861635 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:04.888843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:01:05.012177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0a5991e9-1681-4b58-8d0a-a40f5209e0ea tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 204 len: 0 microversion: 2.1 time: 0.162155 Jun 21 06:01:05.016115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 466/914] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:04 2022] DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:01:05.021418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:05.022093 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:05.028652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:05.029107 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:05.029892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:05.030376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:05.178750 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:05.188530 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8a7beb45-5a57-47d4-bfa1-6fd907bdb9ab tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1683 microversion: 2.1 time: 0.171067 Jun 21 06:01:05.189113 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 449/915] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:05 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:05.780715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:05.781514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:05.788591 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:05.789364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:05.790349 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:05.790936 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:05.960251 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:05.969265 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-be2593d7-7711-4b36-a3bb-32d4bd4fab5d tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.193745 Jun 21 06:01:05.969844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 467/916] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:05 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:06.048628 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:06.049164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:06.056415 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.056818 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.057823 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.058445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.092011 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3ff72dec-4436-4e3b-ba70-db522598245c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/9e7dce98-53ca-47e5-babf-e1f33fd5f198" status: 200 len: 194 microversion: 2.1 time: 0.047489 Jun 21 06:01:06.092636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 450/917] 10.222.0.18 () {58 vars in 1412 bytes} [Tue Jun 21 06:01:06 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/9e7dce98-53ca-47e5-babf-e1f33fd5f198 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:06.102545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:06.103319 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:06.109678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.110303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.111208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.111744 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.203596 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lazy-loading 'services' on Instance uuid 919fe9b8-52bd-465b-ac3f-bd338e6afade {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:01:06.210542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:06.211598 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:06.223353 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.224159 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.225038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.225747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.291938 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e9e7e9c2-5e0b-4e12-85f0-7de5e5eb2586 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/9e7dce98-53ca-47e5-babf-e1f33fd5f198" status: 202 len: 0 microversion: 2.1 time: 0.193003 Jun 21 06:01:06.292545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 468/918] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 06:01:06 2022] DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments/9e7dce98-53ca-47e5-babf-e1f33fd5f198 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:01:06.462140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:06.478046 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1fa944df-5f35-4ae7-a990-02605a7edd11 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1683 microversion: 2.1 time: 0.270305 Jun 21 06:01:06.478906 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 451/919] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:06 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1683 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:06.988636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:06.989375 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:06.997527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.998390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:06.999385 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:06.999833 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.183175 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:07.191205 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5ae7db28-17c8-4286-a9d6-d4ca594d4ecc tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.208210 Jun 21 06:01:07.191783 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 469/920] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:06 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:07.496662 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:07.498164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:07.505587 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.506316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.507098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.507532 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.519715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:07.520735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:07.537243 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.537844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.538928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.539364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.583672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c2f13c57-13d3-4c3e-9a45-6ae001e09ffb tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068037 Jun 21 06:01:07.585039 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 470/921] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:07 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 06:01:07.615482 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:07.623893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-072b6146-8e8f-403c-9d3b-07d29a22bb5d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1615 microversion: 2.1 time: 0.131196 Jun 21 06:01:07.624610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 452/922] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:07 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1615 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:07.721697 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:07.722671 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:07.728554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.728996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.729816 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.730271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.734060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:07.764699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4e456e80-51cc-4031-b61f-b0c62437d795 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046965 Jun 21 06:01:07.766062 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 471/923] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:01:07 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 06:01:07.829576 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:07.830914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:07.837480 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.837953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.839902 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.844557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.882192 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:01:07.896798 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-ca9a1613-a723-4d80-9e3d-9f91d43a84d0 req-9316c2da-e4f6-4294-b6c2-8f37744930ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0106c2-482c-45bf-9b59-c362ffa6ba8c", "name": "network-vif-deleted", "tag": "5ae1b537-6fae-4629-973f-7680b8a4a4f5"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:07.912449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ca9a1613-a723-4d80-9e3d-9f91d43a84d0 req-9316c2da-e4f6-4294-b6c2-8f37744930ee service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:07.913217 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ca9a1613-a723-4d80-9e3d-9f91d43a84d0 req-9316c2da-e4f6-4294-b6c2-8f37744930ee service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:07.947688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-ca9a1613-a723-4d80-9e3d-9f91d43a84d0 req-9316c2da-e4f6-4294-b6c2-8f37744930ee service nova] Creating event network-vif-deleted:5ae1b537-6fae-4629-973f-7680b8a4a4f5 for instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c on hv-cinder-84690 Jun 21 06:01:07.953361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-ca9a1613-a723-4d80-9e3d-9f91d43a84d0 req-9316c2da-e4f6-4294-b6c2-8f37744930ee service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060378 Jun 21 06:01:07.956918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 472/924] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:08.032547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-82c672b5-0d55-4418-b6d3-65e72eb3fba8 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 204 len: 0 microversion: 2.1 time: 0.206783 Jun 21 06:01:08.033273 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 453/925] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:07 2022] DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:01:08.043233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:08.045016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:08.060411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.060862 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.061688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.062241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.208588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:08.209370 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:08.217445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.218260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.219349 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.220140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.253033 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:08.267182 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2f2e7b6f-2562-46b7-a701-779c06f8ab26 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1673 microversion: 2.1 time: 0.229336 Jun 21 06:01:08.274575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 473/926] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:08 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:08.381416 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:08.389886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-eba51137-304a-4166-b9ad-cc8274895bed tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.185578 Jun 21 06:01:08.390979 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 454/927] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:08 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:08.640496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:08.641179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:08.647307 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.647832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.648664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.649165 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.681456 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:08.682025 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:08.682578 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'fault' on Instance uuid 5a0106c2-482c-45bf-9b59-c362ffa6ba8c {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:01:08.724578 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:08.733401 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fe308cb6-96b5-4f46-a092-5e0ca01f2704 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1332 microversion: 2.1 time: 0.096594 Jun 21 06:01:08.734125 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 474/928] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:08 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:09.284687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:09.285286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:09.292262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.292704 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.293469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.293898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.407167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:09.407879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:09.414379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.414934 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.415859 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.416276 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.419991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:09.427489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3ef5ab26-d12e-433f-8ee6-7e458f9870ff tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1673 microversion: 2.1 time: 0.146636 Jun 21 06:01:09.428055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 455/929] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:09 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:09.548670 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:09.556739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8198892e-d8a5-4316-811d-54b0876a6386 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.153325 Jun 21 06:01:09.557840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 475/930] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:09 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:09.751259 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:09.751781 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:09.757848 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.758315 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.759062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.759486 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.789115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:09.789550 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:09.790023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lazy-loading 'fault' on Instance uuid 5a0106c2-482c-45bf-9b59-c362ffa6ba8c {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:01:09.831146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4cd1d7c5a4a4b658f7abf8e434cf716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed1571657afc4ffd9fa9125c251de2c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:09.838724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-64ac734c-f443-455a-ba74-e710475e3a3a tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 200 len: 1332 microversion: 2.1 time: 0.091384 Jun 21 06:01:09.839545 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 456/931] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:09 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:10.444855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:10.445467 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:10.452904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.453567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.454367 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.454812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.575342 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:10.575956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:10.582792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.583450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.584388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.585016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.604847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:10.613328 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f4172f17-479a-409c-9ccb-726b3757e54c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1673 microversion: 2.1 time: 0.171769 Jun 21 06:01:10.613911 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 476/932] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:10 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:10.727933 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:10.735496 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-db91f372-1e37-4ac1-bf22-0a91af41a312 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.164700 Jun 21 06:01:10.736063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 457/933] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:10 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:10.824143 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-900c662c-1cc1-408a-a33d-432ac4214a6c req-4667e4d2-6ef8-4bb5-996d-f1c28843c587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "919fe9b8-52bd-465b-ac3f-bd338e6afade", "name": "network-vif-deleted", "tag": "831f473c-b089-4dc2-87af-a6d77639006e"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:10.832979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-900c662c-1cc1-408a-a33d-432ac4214a6c req-4667e4d2-6ef8-4bb5-996d-f1c28843c587 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.833678 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-900c662c-1cc1-408a-a33d-432ac4214a6c req-4667e4d2-6ef8-4bb5-996d-f1c28843c587 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.847082 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-900c662c-1cc1-408a-a33d-432ac4214a6c req-4667e4d2-6ef8-4bb5-996d-f1c28843c587 service nova] Creating event network-vif-deleted:831f473c-b089-4dc2-87af-a6d77639006e for instance 919fe9b8-52bd-465b-ac3f-bd338e6afade on hv-cinder-84690 Jun 21 06:01:10.852414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-900c662c-1cc1-408a-a33d-432ac4214a6c req-4667e4d2-6ef8-4bb5-996d-f1c28843c587 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032546 Jun 21 06:01:10.853009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 477/934] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:10.855795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:10.856813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:10.862968 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.863412 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.864173 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:10.864604 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:10.878551 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c HTTP/1.1 Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:10.880267 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:10.881890 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '5a0106c2-482c-45bf-9b59-c362ffa6ba8c'} Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:10.882728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:10.884306 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:10.886249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:10.886249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-51ef43f4-3a09-4d93-a8da-9f1f7c66cae8 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 404 len: 111 microversion: 2.1 time: 0.029708 Jun 21 06:01:10.886445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 458/935] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:10 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:10.891577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1ef4785b-311e-456f-ba06-d15de0ee00b4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '.version_select at 0x7efe5c615940>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:10.917231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1ef4785b-311e-456f-ba06-d15de0ee00b4 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510966619" status: 202 len: 0 microversion: 2.1 time: 0.029688 Jun 21 06:01:10.917860 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 478/936] 10.222.0.18 () {58 vars in 1220 bytes} [Tue Jun 21 06:01:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1510966619 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:01:11.630773 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:11.631495 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:11.640529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:11.640529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:11.641003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:11.641603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:11.713801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:11.722857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a5126d57-6519-4c1b-a98e-a3a5aadfd974 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1322 microversion: 2.1 time: 0.096010 Jun 21 06:01:11.723426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 459/937] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:11 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1322 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:11.753309 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:11.754060 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:11.760627 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:11.761078 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:11.761847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:11.762305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:11.899109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:11.907715 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a1c9f2ea-8f59-4514-ab4c-99ea3977c6bd tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.158827 Jun 21 06:01:11.908287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 479/938] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:11 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:12.739871 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:12.740473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:12.747470 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:12.747910 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:12.748662 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:12.749086 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:12.810081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:12.817461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cd4f08fc-910a-475e-9cd3-0ac1b8f578d1 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1322 microversion: 2.1 time: 0.081333 Jun 21 06:01:12.818029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 460/939] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:12 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1322 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:12.925337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:12.925997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:12.932989 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:12.933462 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:12.934629 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:12.935318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.072634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:13.080392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6f1da578-f163-458c-9780-1349b48140ba tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.158969 Jun 21 06:01:13.080962 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 480/940] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:12 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:13.770548 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:13.771040 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:13.778518 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.778960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.779853 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.780283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.793740 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c HTTP/1.1 Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:13.795301 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.796637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '5a0106c2-482c-45bf-9b59-c362ffa6ba8c'} Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:13.797539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.798905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.800419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:13.800419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bf4b13bd-d386-4b93-a818-9e6b1cadcd6d tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 404 len: 111 microversion: 2.1 time: 0.030295 Jun 21 06:01:13.800419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 461/941] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:13 2022] DELETE /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:13.805618 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:13.806333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 5a0106c2-482c-45bf-9b59-c362ffa6ba8c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:13.813253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.813773 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.814645 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.815144 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.829463 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c HTTP/1.1 Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:13.831391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.832991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '5a0106c2-482c-45bf-9b59-c362ffa6ba8c'} Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:13.833882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. Jun 21 06:01:13.835394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:13.836643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 5a0106c2-482c-45bf-9b59-c362ffa6ba8c could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:13.836643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2e32d343-c892-4044-9e66-5d1bf069e226 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c" status: 404 len: 111 microversion: 2.1 time: 0.032500 Jun 21 06:01:13.836804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:13.836804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:13.836958 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 481/942] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:13 2022] GET /compute/v2.1/servers/5a0106c2-482c-45bf-9b59-c362ffa6ba8c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:13.842310 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.842913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.843833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.844443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.878763 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:13.879392 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:13.879993 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lazy-loading 'fault' on Instance uuid 919fe9b8-52bd-465b-ac3f-bd338e6afade {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:01:13.928645 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd380b05ae94a29bdf56c529f1d411e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '219135be95384a599a7c8e7df72175c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:13.936930 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a09abe07-aa54-414a-a0f7-d7fe79fd9c9a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 200 len: 1327 microversion: 2.1 time: 0.107003 Jun 21 06:01:13.937556 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 462/943] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:13 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:14.098682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:14.099312 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:14.106779 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:14.107226 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:14.108009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:14.108446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:14.249587 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:14.257160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-81454609-dd53-4d24-a5cf-ca587730ff2b tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.162667 Jun 21 06:01:14.257722 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 482/944] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:14 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:14.954665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:14.955344 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:14.962556 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:14.962999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:14.964748 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:14.965190 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:14.980557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] HTTP exception thrown: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Request method failure captured: Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade HTTP/1.1 Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0CEODwqigzhUaQ7i3f0wH-ccGUc2zK__lqpMKaE9IiJnoAd5RtVlixi7gr9yZ7St9datBPvogJTTkbpLaqz5bnPVBpnLhNFJN1STgXs-zMBqNOs0B8MMdvGBOM1A-7uP-bz21bxxWAXhaVGH3XZHa-woYOphHv_oiN08HH9dN5ZZE Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:14.982986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219135be95384a599a7c8e7df72175c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219135be95384a599a7c8e7df72175c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: abd380b05ae94a29bdf56c529f1d411e Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:14.984365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '919fe9b8-52bd-465b-ac3f-bd338e6afade'} Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:14.985114 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:14.986437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:14.987729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Returning 404 to user: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:14.987729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-75992d63-14f2-4735-96f0-ab094846493a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 404 len: 111 microversion: 2.1 time: 0.033605 Jun 21 06:01:14.987729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 463/945] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:14 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:14.991209 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:14.991711 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:14.993040 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-902d229c-0eef-46b1-9935-60eb0717ff19 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '.version_select at 0x7efe5c6adca0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:14.998456 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:14.998906 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:14.999680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.000164 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.012731 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-902d229c-0eef-46b1-9935-60eb0717ff19 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496200247" status: 202 len: 0 microversion: 2.1 time: 0.023225 Jun 21 06:01:15.013443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 464/946] 10.222.0.18 () {58 vars in 1217 bytes} [Tue Jun 21 06:01:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496200247 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:01:15.014821 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c HTTP/1.1 Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:15.016509 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.018218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '24a169ff-6c9d-4d88-885a-cb082c72980c'} Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:15.019569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.020766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.022001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:15.022001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e4006877-5f7b-4277-bd54-e7f1a21d3d01 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 404 len: 111 microversion: 2.1 time: 0.030809 Jun 21 06:01:15.022001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 483/947] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:14 2022] DELETE /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:15.026934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:15.027539 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 24a169ff-6c9d-4d88-885a-cb082c72980c] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:15.033747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.034222 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.035037 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.035473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.040467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:15.051243 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c HTTP/1.1 Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:15.053025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.054658 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '24a169ff-6c9d-4d88-885a-cb082c72980c'} Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:15.058125 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. Jun 21 06:01:15.059537 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.060855 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 24a169ff-6c9d-4d88-885a-cb082c72980c could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:15.060855 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8af946db-ceb8-456b-b461-f28fb2330a20 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c" status: 404 len: 111 microversion: 2.1 time: 0.032198 Jun 21 06:01:15.060855 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 465/948] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:15 2022] GET /compute/v2.1/servers/24a169ff-6c9d-4d88-885a-cb082c72980c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:15.063481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:15.063973 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:15.070816 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.071354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.072940 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.073394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.089543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: DELETE /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 HTTP/1.1 Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:15.091331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.092881 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '64a1f275-13ca-4db4-8350-f3b2b5ab7c15'} Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:15.093740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.095808 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.097238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:15.097238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c402ca14-3bef-4785-afdc-9e95f4addddb tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 404 len: 111 microversion: 2.1 time: 0.033196 Jun 21 06:01:15.097238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 484/949] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:15 2022] DELETE /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:15.103009 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:15.104183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 64a1f275-13ca-4db4-8350-f3b2b5ab7c15] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:15.111900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.112542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.113368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.113795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.130728 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 HTTP/1.1 Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:15.132255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.133873 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '64a1f275-13ca-4db4-8350-f3b2b5ab7c15'} Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:15.134805 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. Jun 21 06:01:15.136838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:15.138150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 64a1f275-13ca-4db4-8350-f3b2b5ab7c15 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:15.138150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-67d01cd9-af97-43d4-8701-7eeffd507f82 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15" status: 404 len: 111 microversion: 2.1 time: 0.035942 Jun 21 06:01:15.138150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 466/950] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:15 2022] GET /compute/v2.1/servers/64a1f275-13ca-4db4-8350-f3b2b5ab7c15 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:15.274574 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:15.275299 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:15.282647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.283142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.283976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:15.284477 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:15.503899 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:15.514759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-48249812-a741-4742-a986-e8d37bb7c0d9 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.244159 Jun 21 06:01:15.515336 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 485/951] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:15 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:16.297329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:16.297833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:16.304740 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:16.305192 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:16.305990 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:16.306430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:16.322237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 HTTP/1.1 Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:16.324427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.326140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '598a1303-6c97-4b4d-832a-81f96b131503'} Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:16.326981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.328387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.329790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:16.329790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0d9d6e0b-72b4-4981-9e2d-1353e2f49a34 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 404 len: 111 microversion: 2.1 time: 0.035410 Jun 21 06:01:16.329790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 467/952] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:16 2022] DELETE /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:16.334682 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:16.335303 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] [instance: 598a1303-6c97-4b4d-832a-81f96b131503] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:16.342120 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:16.342556 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:16.343347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:16.343785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:16.357565 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] HTTP exception thrown: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Request method failure captured: Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 HTTP/1.1 Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0EbZ_Twro_ZaBN7N9ocSRnqjDlRH9eYJj8Qrl_jypqqaZDLLQVxlXCUzLP9Rj5bntiew8bcxH7WRUpRCtAVLFvSnttl_MJLrV73DHuJ43MM_XjWORdC4v7fLoqplZ8R0Pnyd4Oyn94mE9vR6u2SGzAGY9TmUPBhF4ePQinI3NlhXE Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:16.359224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/ed1571657afc4ffd9fa9125c251de2c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: ed1571657afc4ffd9fa9125c251de2c8 Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1377983499 Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f4cd1d7c5a4a4b658f7abf8e434cf716 Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeNegativeTest-1377983499-project Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.360840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '598a1303-6c97-4b4d-832a-81f96b131503'} Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:16.361740 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. Jun 21 06:01:16.363329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:16.364728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] Returning 404 to user: Instance 598a1303-6c97-4b4d-832a-81f96b131503 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:16.364728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-7f592c79-137f-4f8f-bde2-f743dbab25d0 tempest-AttachVolumeNegativeTest-1377983499 tempest-AttachVolumeNegativeTest-1377983499-project] 10.222.0.18 "GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503" status: 404 len: 111 microversion: 2.1 time: 0.029870 Jun 21 06:01:16.364728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 486/953] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:16 2022] GET /compute/v2.1/servers/598a1303-6c97-4b4d-832a-81f96b131503 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:16.532569 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:16.533227 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:16.540652 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:16.541773 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:16.542578 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:16.543019 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:16.825442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:16.833332 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-30e43ed1-8d7f-40e8-9d22-0c73f8a7bad6 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.305689 Jun 21 06:01:16.833898 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 468/954] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:16 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:17.851192 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:17.851660 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:17.859944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:17.860775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:17.861545 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:17.861993 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:18.133018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:18.139231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:18.143829 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:18.156775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-846400a2-b644-496e-a523-63621d841348 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.309431 Jun 21 06:01:18.157361 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 487/955] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:17 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:18.158406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:18.159050 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:18.159999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:18.160580 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:18.177055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] HTTP exception thrown: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Request method failure captured: Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade HTTP/1.1 Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0CEODwqigzhUaQ7i3f0wH-ccGUc2zK__lqpMKaE9IiJnoAd5RtVlixi7gr9yZ7St9datBPvogJTTkbpLaqz5bnPVBpnLhNFJN1STgXs-zMBqNOs0B8MMdvGBOM1A-7uP-bz21bxxWAXhaVGH3XZHa-woYOphHv_oiN08HH9dN5ZZE Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:18.178666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219135be95384a599a7c8e7df72175c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219135be95384a599a7c8e7df72175c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: abd380b05ae94a29bdf56c529f1d411e Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.180150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '919fe9b8-52bd-465b-ac3f-bd338e6afade'} Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:18.180962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.186788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.188256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Returning 404 to user: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:18.188256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c00079fb-7faa-4d30-bedd-401a12d6956a tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 404 len: 111 microversion: 2.1 time: 0.051574 Jun 21 06:01:18.188256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 469/956] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:18 2022] DELETE /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:18.193736 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:18.194373 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: 919fe9b8-52bd-465b-ac3f-bd338e6afade] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:18.200483 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:18.200938 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:18.201704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:18.202166 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:18.215952 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] HTTP exception thrown: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Request method failure captured: Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade HTTP/1.1 Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV0CEODwqigzhUaQ7i3f0wH-ccGUc2zK__lqpMKaE9IiJnoAd5RtVlixi7gr9yZ7St9datBPvogJTTkbpLaqz5bnPVBpnLhNFJN1STgXs-zMBqNOs0B8MMdvGBOM1A-7uP-bz21bxxWAXhaVGH3XZHa-woYOphHv_oiN08HH9dN5ZZE Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:18.217490 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219135be95384a599a7c8e7df72175c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219135be95384a599a7c8e7df72175c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: abd380b05ae94a29bdf56c529f1d411e Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.219156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '919fe9b8-52bd-465b-ac3f-bd338e6afade'} Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:18.220294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. Jun 21 06:01:18.221727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:18.223485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Returning 404 to user: Instance 919fe9b8-52bd-465b-ac3f-bd338e6afade could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:18.223485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-293b1b85-9424-42b8-b4fd-19d06f12036c tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade" status: 404 len: 111 microversion: 2.1 time: 0.028982 Jun 21 06:01:18.223485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 488/957] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:18 2022] GET /compute/v2.1/servers/919fe9b8-52bd-465b-ac3f-bd338e6afade => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:19.139059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-917d183b-29ce-4bbe-81ad-f61b35a4f53f req-66d1c118-9bf3-4234-8b4b-9892a5784f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "name": "network-vif-plugged", "status": "completed", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:19.149924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-917d183b-29ce-4bbe-81ad-f61b35a4f53f req-66d1c118-9bf3-4234-8b4b-9892a5784f15 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.151028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-917d183b-29ce-4bbe-81ad-f61b35a4f53f req-66d1c118-9bf3-4234-8b4b-9892a5784f15 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.164993 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-917d183b-29ce-4bbe-81ad-f61b35a4f53f req-66d1c118-9bf3-4234-8b4b-9892a5784f15 service nova] Creating event network-vif-plugged:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 06:01:19.171280 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-917d183b-29ce-4bbe-81ad-f61b35a4f53f req-66d1c118-9bf3-4234-8b4b-9892a5784f15 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036347 Jun 21 06:01:19.172553 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 470/958] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:19.174795 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:19.175941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:19.178443 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:19.187906 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.190043 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.192167 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.192963 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.407588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:19.425109 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:19.433142 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.433603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.434547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.434988 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.454242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] HTTP exception thrown: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Request method failure captured: Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e HTTP/1.1 Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0CEODwqigzhUaQ7i3f0wH-ccGUc2zK__lqpMKaE9IiJnoAd5RtVlixi7gr9yZ7St9datBPvogJTTkbpLaqz5bnPVBpnLhNFJN1STgXs-zMBqNOs0B8MMdvGBOM1A-7uP-bz21bxxWAXhaVGH3XZHa-woYOphHv_oiN08HH9dN5ZZE Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:19.460963 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219135be95384a599a7c8e7df72175c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219135be95384a599a7c8e7df72175c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: abd380b05ae94a29bdf56c529f1d411e Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.462422 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'a038cbd5-199a-4273-8ded-1fd9a3528a0e'} Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:19.463305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.464785 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.466066 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Returning 404 to user: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:19.466066 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-416c8100-d4bd-4c60-b607-2518e550d0f0 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 404 len: 111 microversion: 2.1 time: 0.060302 Jun 21 06:01:19.470264 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 471/959] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:01:19 2022] DELETE /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:19.477244 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:19.478237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] [instance: a038cbd5-199a-4273-8ded-1fd9a3528a0e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:19.483426 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:19.492152 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e0a3f3b2-2dec-48dc-bc87-e1f6e5fc9626 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.321322 Jun 21 06:01:19.495535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 489/960] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:19 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:01:19.499926 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.500575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.501488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:19.502102 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:19.521974 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] HTTP exception thrown: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Request method failure captured: Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e HTTP/1.1 Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV0CEODwqigzhUaQ7i3f0wH-ccGUc2zK__lqpMKaE9IiJnoAd5RtVlixi7gr9yZ7St9datBPvogJTTkbpLaqz5bnPVBpnLhNFJN1STgXs-zMBqNOs0B8MMdvGBOM1A-7uP-bz21bxxWAXhaVGH3XZHa-woYOphHv_oiN08HH9dN5ZZE Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:19.523901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/219135be95384a599a7c8e7df72175c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_219135be95384a599a7c8e7df72175c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/219135be95384a599a7c8e7df72175c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 219135be95384a599a7c8e7df72175c2 Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746648515 Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: abd380b05ae94a29bdf56c529f1d411e Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeTestJSON-1746648515-project Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.525609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'a038cbd5-199a-4273-8ded-1fd9a3528a0e'} Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:19.526485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. Jun 21 06:01:19.527934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:19.529032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] Returning 404 to user: Instance a038cbd5-199a-4273-8ded-1fd9a3528a0e could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:19.529032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3880505a-1e82-427f-9876-971def0c8101 tempest-AttachVolumeTestJSON-1746648515 tempest-AttachVolumeTestJSON-1746648515-project] 10.222.0.18 "GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e" status: 404 len: 111 microversion: 2.1 time: 0.053998 Jun 21 06:01:19.529032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 472/961] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:19 2022] GET /compute/v2.1/servers/a038cbd5-199a-4273-8ded-1fd9a3528a0e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:20.513712 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:20.514472 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:20.522473 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:20.523381 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:20.524768 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:20.526500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:20.737720 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:20.747460 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-852080c0-7d81-424c-92ec-417f94637a28 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1574 microversion: 2.1 time: 0.238600 Jun 21 06:01:20.749991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 490/962] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:20 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:21.764461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:21.765184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:21.768118 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:21.779348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:21.780023 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:21.780877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:21.782850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:21.957908 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:21.968992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f32d79e9-46ea-46b9-97f8-8942d11f5110 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1561 microversion: 2.1 time: 0.208249 Jun 21 06:01:21.970006 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 473/963] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:01:21 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1561 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:25.176397 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e681d304-9977-42a2-b21f-e43642d0e0ca tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Action: 'create', calling method: .version_select at 0x7efe5c6b8550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1243792162"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:25.476485 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e681d304-9977-42a2-b21f-e43642d0e0ca tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.558983 Jun 21 06:01:25.477108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 491/964] 10.222.0.18 () {60 vars in 1154 bytes} [Tue Jun 21 06:01:24 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 560 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 21 06:01:25.488339 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f0afdec0-3502-4f6c-a458-c307c3f47e1d tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c6005e0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:25.540098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f0afdec0-3502-4f6c-a458-c307c3f47e1d tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 200 len: 345 microversion: 2.1 time: 0.055879 Jun 21 06:01:25.540712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 474/965] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:25 2022] GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:26.555418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-28c0daa7-d7b2-4508-a0b5-75c16d7b4e7e tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c5b9820>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:26.628904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-28c0daa7-d7b2-4508-a0b5-75c16d7b4e7e tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 200 len: 346 microversion: 2.1 time: 0.078283 Jun 21 06:01:26.629659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 492/966] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:26 2022] GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 346 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:01:26.640800 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3b5e14f6-b61a-4507-a705-712792e13707 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Action: 'create', calling method: .version_select at 0x7efe5c6a61f0>, body: {"snapshot": {"volume_id": "8f45bee8-79fc-4138-81a9-cf0abc145b09", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1964946543"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:26.807144 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3b5e14f6-b61a-4507-a705-712792e13707 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.169924 Jun 21 06:01:26.807773 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 475/967] 10.222.0.18 () {60 vars in 1161 bytes} [Tue Jun 21 06:01:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:26.817806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3f0cf966-0513-412d-aa17-fb5ae5a569bd tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c5b9430>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:26.851427 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3f0cf966-0513-412d-aa17-fb5ae5a569bd tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 200 len: 287 microversion: 2.1 time: 0.037319 Jun 21 06:01:26.852004 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 493/968] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:26 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:01:26.862355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0242e653-9d53-4c7f-8358-1e0963431901 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c6311f0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:26.893788 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0242e653-9d53-4c7f-8358-1e0963431901 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035186 Jun 21 06:01:26.905072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 476/969] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Jun 21 06:01:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:26.905489 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-63cf9a1f-d161-4b59-92e0-0090053547be tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c5b9550>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:26.937423 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-63cf9a1f-d161-4b59-92e0-0090053547be tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 200 len: 287 microversion: 2.1 time: 0.036238 Jun 21 06:01:26.938013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 494/970] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:26 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:01:27.949464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-eb099712-93df-44f3-a43f-a5c0ff47d7ca tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c60ec10>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:27.983641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-eb099712-93df-44f3-a43f-a5c0ff47d7ca tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 200 len: 287 microversion: 2.1 time: 0.037636 Jun 21 06:01:27.984489 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 477/971] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:27 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:28.996352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-61761ac1-f988-4460-84de-b14174d27f01 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c5c5670>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:29.035312 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-61761ac1-f988-4460-84de-b14174d27f01 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 200 len: 287 microversion: 2.1 time: 0.043577 Jun 21 06:01:29.036945 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 495/972] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:28 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:29.857660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:29.858708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:29.866836 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:29.867283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:29.868104 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:29.868507 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:29.910640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-637ccb50-509b-4909-aeed-b3289d05cabb tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057846 Jun 21 06:01:29.911232 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 478/973] 10.222.0.18 () {60 vars in 1342 bytes} [Tue Jun 21 06:01:29 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:29.975625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:29.976377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:29.985580 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:29.986169 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:29.987071 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:29.987563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:30.018449 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:01:30.048572 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bc247eb6-92ee-4906-b0d0-9f5fa20da2bb tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c879ca0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:30.088324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:30.089399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bc247eb6-92ee-4906-b0d0-9f5fa20da2bb tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 200 len: 288 microversion: 2.1 time: 0.044752 Jun 21 06:01:30.089994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 479/974] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:30 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:01:30.128275 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-026ad34f-aee9-4af0-b5c7-f81575e66872 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c606dc0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:30.156512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4c61eda7-88ef-4c7e-9bbf-e9cdee27f985 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 204 len: 0 microversion: 2.20 time: 0.182755 Jun 21 06:01:30.157458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 496/975] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 21 06:01:29 2022] DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 06:01:30.176457 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:30.179042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:30.194258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:30.196235 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:30.198841 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:30.199541 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:30.231481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-026ad34f-aee9-4af0-b5c7-f81575e66872 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "DELETE /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 202 len: 0 microversion: 2.1 time: 0.134926 Jun 21 06:01:30.232617 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 480/976] 10.222.0.18 () {58 vars in 1253 bytes} [Tue Jun 21 06:01:30 2022] DELETE /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 06:01:30.242561 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-adf563cd-0992-4f70-9ac7-0ff9b2027873 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c60e310>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:30.282435 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-adf563cd-0992-4f70-9ac7-0ff9b2027873 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 200 len: 287 microversion: 2.1 time: 0.044476 Jun 21 06:01:30.283777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 481/977] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:30 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:30.350510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:30.359597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:30.361206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:30.362476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-2cdd7ce6-3f32-44b0-a9d3-92e0da737c6d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.199414 Jun 21 06:01:30.363068 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 497/978] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:01:30 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:01:31.295172 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-32040109-ba40-4b2b-b746-453a23f4aa84 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c606dc0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:31.320078 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-32040109-ba40-4b2b-b746-453a23f4aa84 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] HTTP exception thrown: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-32040109-ba40-4b2b-b746-453a23f4aa84 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Request method failure captured: Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 HTTP/1.1 Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV60Ijr7-KWt_9YxRvipR-schUe_sSwkjXh-TFyViVM1pi_NXB6brqE61qR6WWCShevuvNfxEIujP-TTNHsN8KaW4bueUdgsbBnWnDLLpBluDnqfm_YtAkxws5JvNHrwR6rC3l8nriYavqgaz-PIP-9Rq42FqQrR8_eyrCizwm_pXxs Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:31.323402 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e9541fafe1549a38b7c8112af851961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 8e69ed7fbf6f4d0f8138d9235df45f56 Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '322f1d83-e9a1-42bd-8815-d0306f3f14d8'} Jun 21 06:01:31.325001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. (HTTP 404) (Request-ID: req-5d82f255-cbe1-45c4-8940-f7ec203bc090) Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.326060 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:31.327418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 21 06:01:31.329189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-32040109-ba40-4b2b-b746-453a23f4aa84 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Returning 404 to user: Snapshot 322f1d83-e9a1-42bd-8815-d0306f3f14d8 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:31.330462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-32040109-ba40-4b2b-b746-453a23f4aa84 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8" status: 404 len: 111 microversion: 2.1 time: 0.036071 Jun 21 06:01:31.331304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 482/979] 10.222.0.18 () {58 vars in 1250 bytes} [Tue Jun 21 06:01:31 2022] GET /compute/v2.1/os-snapshots/322f1d83-e9a1-42bd-8815-d0306f3f14d8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:31.336836 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ae200db1-e499-4633-8fa9-02c899fc27ff tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c6b89d0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:31.382286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:31.382950 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:31.391344 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:31.392240 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:31.393285 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:31.393969 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:31.407674 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ae200db1-e499-4633-8fa9-02c899fc27ff tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 202 len: 0 microversion: 2.1 time: 0.074995 Jun 21 06:01:31.408443 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 498/980] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 06:01:31 2022] DELETE /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:01:31.418220 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-494c4b3c-9b40-45ab-b413-78edf8d0f9c6 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c750310>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:31.478108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-494c4b3c-9b40-45ab-b413-78edf8d0f9c6 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 200 len: 345 microversion: 2.1 time: 0.064876 Jun 21 06:01:31.478760 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 499/981] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:31 2022] GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:01:31.528886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:31.537148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:31.538869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:31.540272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-47dcc3d8-ba70-4f7e-9d19-e07b155a395a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1723 microversion: 2.20 time: 0.162155 Jun 21 06:01:31.540869 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 483/982] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:01:31 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 21 06:01:32.500160 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-69c47833-8174-4a72-a47b-07b4fb9ad228 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c7a0d30>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:32.534848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-69c47833-8174-4a72-a47b-07b4fb9ad228 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] HTTP exception thrown: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-69c47833-8174-4a72-a47b-07b4fb9ad228 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Request method failure captured: Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 HTTP/1.1 Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV60Ijr7-KWt_9YxRvipR-schUe_sSwkjXh-TFyViVM1pi_NXB6brqE61qR6WWCShevuvNfxEIujP-TTNHsN8KaW4bueUdgsbBnWnDLLpBluDnqfm_YtAkxws5JvNHrwR6rC3l8nriYavqgaz-PIP-9Rq42FqQrR8_eyrCizwm_pXxs Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:32.537318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e9541fafe1549a38b7c8112af851961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 8e69ed7fbf6f4d0f8138d9235df45f56 Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '8f45bee8-79fc-4138-81a9-cf0abc145b09'} Jun 21 06:01:32.538789 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. (HTTP 404) (Request-ID: req-3224e4a0-9c0d-4085-b9e8-4ce8653ce423) Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.539599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:32.541305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 06:01:32.543540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-69c47833-8174-4a72-a47b-07b4fb9ad228 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Returning 404 to user: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-69c47833-8174-4a72-a47b-07b4fb9ad228 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 404 len: 109 microversion: 2.1 time: 0.051356 Jun 21 06:01:32.544709 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 500/983] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:32 2022] GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:32.562683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0f32ce52-2168-45b8-ad04-c7bd9afdae53 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c6a6310>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:32.577096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:32.579206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:32.586928 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:32.587680 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:32.589168 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:32.590176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:32.613148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-0f32ce52-2168-45b8-ad04-c7bd9afdae53 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] HTTP exception thrown: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0f32ce52-2168-45b8-ad04-c7bd9afdae53 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Request method failure captured: Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 HTTP/1.1 Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV60Ijr7-KWt_9YxRvipR-schUe_sSwkjXh-TFyViVM1pi_NXB6brqE61qR6WWCShevuvNfxEIujP-TTNHsN8KaW4bueUdgsbBnWnDLLpBluDnqfm_YtAkxws5JvNHrwR6rC3l8nriYavqgaz-PIP-9Rq42FqQrR8_eyrCizwm_pXxs Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:32.615637 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e9541fafe1549a38b7c8112af851961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 8e69ed7fbf6f4d0f8138d9235df45f56 Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '8f45bee8-79fc-4138-81a9-cf0abc145b09'} Jun 21 06:01:32.617082 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. (HTTP 404) (Request-ID: req-66debe33-fdf1-4dd2-a28d-df1b32dc1df6) Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.618045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 06:01:32.622860 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 06:01:32.625323 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0f32ce52-2168-45b8-ad04-c7bd9afdae53 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Returning 404 to user: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0f32ce52-2168-45b8-ad04-c7bd9afdae53 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 404 len: 109 microversion: 2.1 time: 0.071171 Jun 21 06:01:32.627241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 484/984] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 06:01:32 2022] DELETE /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:32.634008 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b2c71014-f3fc-4ced-a778-54745e8bd643 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Calling method '.version_select at 0x7efe5c626820>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:32.709041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-b2c71014-f3fc-4ced-a778-54745e8bd643 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] HTTP exception thrown: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b2c71014-f3fc-4ced-a778-54745e8bd643 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Request method failure captured: Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 HTTP/1.1 Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV60Ijr7-KWt_9YxRvipR-schUe_sSwkjXh-TFyViVM1pi_NXB6brqE61qR6WWCShevuvNfxEIujP-TTNHsN8KaW4bueUdgsbBnWnDLLpBluDnqfm_YtAkxws5JvNHrwR6rC3l8nriYavqgaz-PIP-9Rq42FqQrR8_eyrCizwm_pXxs Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:32.712861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_7e9541fafe1549a38b7c8112af851961"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/7e9541fafe1549a38b7c8112af851961"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 7e9541fafe1549a38b7c8112af851961 Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1334509164 Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 8e69ed7fbf6f4d0f8138d9235df45f56 Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1334509164-project Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '8f45bee8-79fc-4138-81a9-cf0abc145b09'} Jun 21 06:01:32.714830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. (HTTP 404) (Request-ID: req-0048c586-c097-45b8-b1f7-23217fbfb631) Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.715674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:32.716826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 06:01:32.720258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. Jun 21 06:01:32.724833 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:32.728463 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b2c71014-f3fc-4ced-a778-54745e8bd643 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] Returning 404 to user: Volume 8f45bee8-79fc-4138-81a9-cf0abc145b09 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:32.729549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b2c71014-f3fc-4ced-a778-54745e8bd643 tempest-VolumesSnapshotsTestJSON-1334509164 tempest-VolumesSnapshotsTestJSON-1334509164-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09" status: 404 len: 109 microversion: 2.1 time: 0.106308 Jun 21 06:01:32.730385 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 485/985] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:32 2022] GET /compute/v2.1/os-volumes/8f45bee8-79fc-4138-81a9-cf0abc145b09 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:32.750853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:32.753246 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-d43514ae-494b-40fb-8983-5d532ec26508 req-be04d343-2de7-44a0-bb74-49f39ab4d17e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f352939b-c3a3-4788-b6f2-22319aa6e044", "name": "network-vif-deleted", "tag": "83ba6585-227c-4678-8bb8-307be75c8ca5"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:32.766806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:32.770465 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-d43514ae-494b-40fb-8983-5d532ec26508 req-be04d343-2de7-44a0-bb74-49f39ab4d17e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:32.771087 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-d43514ae-494b-40fb-8983-5d532ec26508 req-be04d343-2de7-44a0-bb74-49f39ab4d17e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:32.771712 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7e3e3935d57a48f195a568f90ed25a8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd71c895fde074698b9717d2a770ef5bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:01:32.776526 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f05ec798-a1a7-44cf-a532-670eef2f9733 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 200 len: 1655 microversion: 2.20 time: 0.204822 Jun 21 06:01:32.777214 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 501/986] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:01:32 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 1655 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 21 06:01:32.805400 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-d43514ae-494b-40fb-8983-5d532ec26508 req-be04d343-2de7-44a0-bb74-49f39ab4d17e service nova] Creating event network-vif-deleted:83ba6585-227c-4678-8bb8-307be75c8ca5 for instance f352939b-c3a3-4788-b6f2-22319aa6e044 on hv-cinder-84690 Jun 21 06:01:32.822202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-d43514ae-494b-40fb-8983-5d532ec26508 req-be04d343-2de7-44a0-bb74-49f39ab4d17e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090331 Jun 21 06:01:32.829423 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 486/987] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:33.796701 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:33.797561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:33.808151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:33.808717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:33.809583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:33.810107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:33.834028 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] HTTP exception thrown: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Request method failure captured: Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 HTTP/1.1 Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisVz7ssD4Co4lI_VifqdAbcMmRp7Ps-aT0RLLkNPiJPSe3BKmb0Tr6y933SpJ4PJwu7t5QgxhyyQ5oZWODeb3qh5Yr_7SJwiyXk6JzP6wOP8G_vPc_itGLney_TqqaKJFUxhC5RZQv3mDPiy4uQh0typJIBHz7L8LbWs8LfN7J3HVmoQ Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:33.836159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 7e3e3935d57a48f195a568f90ed25a8a Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:33.837891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'f352939b-c3a3-4788-b6f2-22319aa6e044'} Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:33.839091 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:33.840852 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:33.843589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Returning 404 to user: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:33.844606 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-dd4df56c-4da2-4109-8014-ae70c3310af0 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 404 len: 111 microversion: 2.20 time: 0.052496 Jun 21 06:01:33.846101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 502/988] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:01:33 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:33.863676 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e5beffb1-4ec0-4f25-b986-662779ebef37 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '.version_select at 0x7efe5c631af0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:33.891877 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e5beffb1-4ec0-4f25-b986-662779ebef37 tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104900756" status: 204 len: 0 microversion: 2.20 time: 0.032120 Jun 21 06:01:33.892713 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 487/989] 10.222.0.18 () {60 vars in 1261 bytes} [Tue Jun 21 06:01:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104900756 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 21 06:01:34.876237 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-93cbe042-f762-403f-9b48-d45e9021f3c6 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Action: 'create', calling method: .version_select at 0x7efe5d3f9af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-747707074", "metadata": {"Type": "work"}}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-93cbe042-f762-403f-9b48-d45e9021f3c6 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Request method failure captured: Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 121 Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV6-A3gLsiLGm0bYvn2fnulOeYoB7qRkUZY1lF3R8hBU-7eD_tEfdy1HwLT3O6upTxlJ0UONMeXik97v1_Z7vG3b1My6GxQinZlGuqo6nAZK52NZU47D9D02LFyXQgO9_hkvBXokOHXKHwZbiqbFBlwBCDIsvA9sa-84JcukzS8FHtg Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:34.896521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 3e27d4f743e541a9896e708a722384e8 Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-747707074", "metadata": {"Type": "work"}}} Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: Jun 21 06:01:34.898418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-747707074', 'metadata': {'Type': 'work'}}}} Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise error Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi '#$%' Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:34.900053 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 06:01:34.902354 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 06:01:34.903889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 21 06:01:34.903889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.903889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-93cbe042-f762-403f-9b48-d45e9021f3c6 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:34.903889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-93cbe042-f762-403f-9b48-d45e9021f3c6 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.183331 Jun 21 06:01:34.903889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 503/990] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 21 06:01:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 185 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:34.914556 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b66c575b-f849-4e29-842e-018f81440314 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Action: 'create', calling method: .version_select at 0x7efe5c6cd430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1356749043", "metadata": {"Type": "work"}}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b66c575b-f849-4e29-842e-018f81440314 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Request method failure captured: Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 120 Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV6-A3gLsiLGm0bYvn2fnulOeYoB7qRkUZY1lF3R8hBU-7eD_tEfdy1HwLT3O6upTxlJ0UONMeXik97v1_Z7vG3b1My6GxQinZlGuqo6nAZK52NZU47D9D02LFyXQgO9_hkvBXokOHXKHwZbiqbFBlwBCDIsvA9sa-84JcukzS8FHtg Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:34.918063 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 3e27d4f743e541a9896e708a722384e8 Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1356749043", "metadata": {"Type": "work"}}} Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: Jun 21 06:01:34.924903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1356749043', 'metadata': {'Type': 'work'}}}} Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise error Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi '0' Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:34.926038 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 06:01:34.928466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 06:01:34.931170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 21 06:01:34.931170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.931170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b66c575b-f849-4e29-842e-018f81440314 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:34.931170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b66c575b-f849-4e29-842e-018f81440314 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009814 Jun 21 06:01:34.931170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 488/991] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 21 06:01:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:34.931985 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-05f7cf25-81cd-4bd1-b4bb-93921b155ec0 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Action: 'create', calling method: .version_select at 0x7efe5c7e6040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1816192065", "metadata": {"Type": "work"}}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-05f7cf25-81cd-4bd1-b4bb-93921b155ec0 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Request method failure captured: Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 119 Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV6-A3gLsiLGm0bYvn2fnulOeYoB7qRkUZY1lF3R8hBU-7eD_tEfdy1HwLT3O6upTxlJ0UONMeXik97v1_Z7vG3b1My6GxQinZlGuqo6nAZK52NZU47D9D02LFyXQgO9_hkvBXokOHXKHwZbiqbFBlwBCDIsvA9sa-84JcukzS8FHtg Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:34.934173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 3e27d4f743e541a9896e708a722384e8 Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1816192065", "metadata": {"Type": "work"}}} Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: Jun 21 06:01:34.938471 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1816192065', 'metadata': {'Type': 'work'}}}} Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise error Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi '' Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:34.939536 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 21 06:01:34.940916 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 21 06:01:34.942126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 21 06:01:34.942126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.942126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-05f7cf25-81cd-4bd1-b4bb-93921b155ec0 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:34.942126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-05f7cf25-81cd-4bd1-b4bb-93921b155ec0 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009618 Jun 21 06:01:34.942126 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 504/992] 10.222.0.18 () {60 vars in 1155 bytes} [Tue Jun 21 06:01:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:34.951838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6ca7dbf1-b136-49f4-95f3-95198a7632f9 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Calling method '.version_select at 0x7efe5c6cd5e0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:34.990287 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-6ca7dbf1-b136-49f4-95f3-95198a7632f9 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] HTTP exception thrown: Volume tempest-invalid-258473933 could not be found. Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6ca7dbf1-b136-49f4-95f3-95198a7632f9 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Request method failure captured: Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-258473933 HTTP/1.1 Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV6-A3gLsiLGm0bYvn2fnulOeYoB7qRkUZY1lF3R8hBU-7eD_tEfdy1HwLT3O6upTxlJ0UONMeXik97v1_Z7vG3b1My6GxQinZlGuqo6nAZK52NZU47D9D02LFyXQgO9_hkvBXokOHXKHwZbiqbFBlwBCDIsvA9sa-84JcukzS8FHtg Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:34.992334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 3e27d4f743e541a9896e708a722384e8 Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Volume tempest-invalid-258473933 could not be found. Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'tempest-invalid-258473933'} Jun 21 06:01:34.994523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-258473933 could not be found. (HTTP 404) (Request-ID: req-b5bd4e36-c5a1-4f06-bd02-b50c363f66a6) Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:34.998633 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 06:01:35.000304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-258473933 could not be found. Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:35.001609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-258473933 could not be found. Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-258473933 could not be found. Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6ca7dbf1-b136-49f4-95f3-95198a7632f9 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Returning 404 to user: Volume tempest-invalid-258473933 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6ca7dbf1-b136-49f4-95f3-95198a7632f9 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/tempest-invalid-258473933" status: 404 len: 98 microversion: 2.1 time: 0.047876 Jun 21 06:01:35.002987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 489/993] 10.222.0.18 () {58 vars in 1214 bytes} [Tue Jun 21 06:01:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-258473933 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 21 06:01:35.003811 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4f513557-ec08-4f64-a4a7-be83f7a7024f tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003676 Jun 21 06:01:35.004456 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 505/994] 10.222.0.18 () {58 vars in 1139 bytes} [Tue Jun 21 06:01:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 06:01:35.014129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-63a30fe2-67bd-48c3-8de2-22f3cd72556b tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005013 Jun 21 06:01:35.014920 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 490/995] 10.222.0.18 () {58 vars in 1136 bytes} [Tue Jun 21 06:01:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 21 06:01:35.023363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-188619a0-0aec-40d9-b5df-c291bd8cd547 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Calling method '.version_select at 0x7efe5c750c10>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:35.052075 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-188619a0-0aec-40d9-b5df-c291bd8cd547 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] HTTP exception thrown: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-188619a0-0aec-40d9-b5df-c291bd8cd547 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Request method failure captured: Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: DELETE /compute/v2.1/os-volumes/e103d20f-d68b-4742-a98f-440cfb633bc8 HTTP/1.1 Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV6-A3gLsiLGm0bYvn2fnulOeYoB7qRkUZY1lF3R8hBU-7eD_tEfdy1HwLT3O6upTxlJ0UONMeXik97v1_Z7vG3b1My6GxQinZlGuqo6nAZK52NZU47D9D02LFyXQgO9_hkvBXokOHXKHwZbiqbFBlwBCDIsvA9sa-84JcukzS8FHtg Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:35.054116 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 3e27d4f743e541a9896e708a722384e8 Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'e103d20f-d68b-4742-a98f-440cfb633bc8'} Jun 21 06:01:35.056153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. (HTTP 404) (Request-ID: req-4f433d09-4e9f-494d-8e6c-72bdc6d55796) Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.056995 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 21 06:01:35.058223 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 21 06:01:35.059358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-188619a0-0aec-40d9-b5df-c291bd8cd547 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Returning 404 to user: Volume e103d20f-d68b-4742-a98f-440cfb633bc8 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:35.060514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-188619a0-0aec-40d9-b5df-c291bd8cd547 tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "DELETE /compute/v2.1/os-volumes/e103d20f-d68b-4742-a98f-440cfb633bc8" status: 404 len: 109 microversion: 2.1 time: 0.036238 Jun 21 06:01:35.061327 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 506/996] 10.222.0.18 () {58 vars in 1247 bytes} [Tue Jun 21 06:01:35 2022] DELETE /compute/v2.1/os-volumes/e103d20f-d68b-4742-a98f-440cfb633bc8 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:01:35.066374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a667195f-cfe8-4a64-9ed1-8bfd76c5be3d tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Calling method '.version_select at 0x7efe5c6a61f0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:35.099782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-a667195f-cfe8-4a64-9ed1-8bfd76c5be3d tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] HTTP exception thrown: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a667195f-cfe8-4a64-9ed1-8bfd76c5be3d tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Request method failure captured: Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/os-volumes/9891f6be-eb67-43f9-96ae-869d233e0f79 HTTP/1.1 Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV6-A3gLsiLGm0bYvn2fnulOeYoB7qRkUZY1lF3R8hBU-7eD_tEfdy1HwLT3O6upTxlJ0UONMeXik97v1_Z7vG3b1My6GxQinZlGuqo6nAZK52NZU47D9D02LFyXQgO9_hkvBXokOHXKHwZbiqbFBlwBCDIsvA9sa-84JcukzS8FHtg Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:35.102697 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/24b5a22b29f74b60b3d6fb8abb90b157"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 24b5a22b29f74b60b3d6fb8abb90b157 Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-VolumesNegativeTest-1874536261 Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 3e27d4f743e541a9896e708a722384e8 Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-VolumesNegativeTest-1874536261-project Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '9891f6be-eb67-43f9-96ae-869d233e0f79'} Jun 21 06:01:35.104074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. (HTTP 404) (Request-ID: req-326ba6db-84e9-407f-b881-971cc0b2cec4) Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.104896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 21 06:01:35.106089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 21 06:01:35.107261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a667195f-cfe8-4a64-9ed1-8bfd76c5be3d tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] Returning 404 to user: Volume 9891f6be-eb67-43f9-96ae-869d233e0f79 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a667195f-cfe8-4a64-9ed1-8bfd76c5be3d tempest-VolumesNegativeTest-1874536261 tempest-VolumesNegativeTest-1874536261-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/9891f6be-eb67-43f9-96ae-869d233e0f79" status: 404 len: 109 microversion: 2.1 time: 0.041883 Jun 21 06:01:35.108683 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 491/997] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:35 2022] GET /compute/v2.1/os-volumes/9891f6be-eb67-43f9-96ae-869d233e0f79 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:01:36.036874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:36.038029 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:36.044731 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:36.045174 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:36.045987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:36.046634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:36.063092 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] HTTP exception thrown: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Request method failure captured: Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 HTTP/1.1 Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisVz7ssD4Co4lI_VifqdAbcMmRp7Ps-aT0RLLkNPiJPSe3BKmb0Tr6y933SpJ4PJwu7t5QgxhyyQ5oZWODeb3qh5Yr_7SJwiyXk6JzP6wOP8G_vPc_itGLney_TqqaKJFUxhC5RZQv3mDPiy4uQh0typJIBHz7L8LbWs8LfN7J3HVmoQ Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:36.064656 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 7e3e3935d57a48f195a568f90ed25a8a Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.066190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'f352939b-c3a3-4788-b6f2-22319aa6e044'} Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:36.066941 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.068170 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.069461 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Returning 404 to user: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:36.069461 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4b7d091d-62b5-41ab-9d28-d81191eeaf9a tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 404 len: 111 microversion: 2.20 time: 0.036912 Jun 21 06:01:36.069461 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 507/998] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 21 06:01:36 2022] DELETE /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:36.076447 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:36.077344 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: f352939b-c3a3-4788-b6f2-22319aa6e044] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:36.084053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:36.084622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:36.085415 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:36.085904 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:36.101223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] HTTP exception thrown: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Request method failure captured: Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 HTTP/1.1 Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisVz7ssD4Co4lI_VifqdAbcMmRp7Ps-aT0RLLkNPiJPSe3BKmb0Tr6y933SpJ4PJwu7t5QgxhyyQ5oZWODeb3qh5Yr_7SJwiyXk6JzP6wOP8G_vPc_itGLney_TqqaKJFUxhC5RZQv3mDPiy4uQh0typJIBHz7L8LbWs8LfN7J3HVmoQ Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:36.102928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 7e3e3935d57a48f195a568f90ed25a8a Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.104593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'f352939b-c3a3-4788-b6f2-22319aa6e044'} Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:36.105493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. Jun 21 06:01:36.106994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:36.108942 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Returning 404 to user: Instance f352939b-c3a3-4788-b6f2-22319aa6e044 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:36.108942 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a701fc0c-4177-4074-9ff3-cbdc13cb5a1e tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044" status: 404 len: 111 microversion: 2.20 time: 0.034502 Jun 21 06:01:36.108942 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 492/999] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:01:36 2022] GET /compute/v2.1/servers/f352939b-c3a3-4788-b6f2-22319aa6e044 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:37.333103 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:37.333634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:37.345607 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:37.346417 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:37.350022 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:37.350688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:37.376742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] HTTP exception thrown: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Request method failure captured: Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 HTTP/1.1 Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisVz7ssD4Co4lI_VifqdAbcMmRp7Ps-aT0RLLkNPiJPSe3BKmb0Tr6y933SpJ4PJwu7t5QgxhyyQ5oZWODeb3qh5Yr_7SJwiyXk6JzP6wOP8G_vPc_itGLney_TqqaKJFUxhC5RZQv3mDPiy4uQh0typJIBHz7L8LbWs8LfN7J3HVmoQ Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:01:37.379582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: 7e3e3935d57a48f195a568f90ed25a8a Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.381016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'ec84758b-79f0-4883-8081-9b2b09d7b812'} Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:37.385197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.387109 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.388747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Returning 404 to user: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:37.388747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1c5a9076-26bf-4c62-a214-b038971f61ed tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 404 len: 111 microversion: 2.20 time: 0.052485 Jun 21 06:01:37.388747 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 508/1000] 10.222.0.18 () {60 vars in 1279 bytes} [Tue Jun 21 06:01:37 2022] DELETE /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:37.392987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:37.393654 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] [instance: ec84758b-79f0-4883-8081-9b2b09d7b812] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:01:37.401305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:37.401772 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:37.402720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:01:37.403178 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:01:37.418472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] HTTP exception thrown: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Request method failure captured: Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 HTTP/1.1 Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisVz7ssD4Co4lI_VifqdAbcMmRp7Ps-aT0RLLkNPiJPSe3BKmb0Tr6y933SpJ4PJwu7t5QgxhyyQ5oZWODeb3qh5Yr_7SJwiyXk6JzP6wOP8G_vPc_itGLney_TqqaKJFUxhC5RZQv3mDPiy4uQh0typJIBHz7L8LbWs8LfN7J3HVmoQ Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Openstack-Nova-Api-Version: 2.20 Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:01:37.420179 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/d71c895fde074698b9717d2a770ef5bf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: d71c895fde074698b9717d2a770ef5bf Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1447072397 Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 7e3e3935d57a48f195a568f90ed25a8a Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1447072397-project Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.421901 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': 'ec84758b-79f0-4883-8081-9b2b09d7b812'} Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:01:37.422789 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. Jun 21 06:01:37.424115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:01:37.425211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] Returning 404 to user: Instance ec84758b-79f0-4883-8081-9b2b09d7b812 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:01:37.425211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e5e23ee2-9a38-4002-bb66-ab782086126d tempest-AttachVolumeShelveTestJSON-1447072397 tempest-AttachVolumeShelveTestJSON-1447072397-project] 10.222.0.18 "GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812" status: 404 len: 111 microversion: 2.20 time: 0.034295 Jun 21 06:01:37.425211 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 493/1001] 10.222.0.18 () {60 vars in 1276 bytes} [Tue Jun 21 06:01:37 2022] GET /compute/v2.1/servers/ec84758b-79f0-4883-8081-9b2b09d7b812 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 21 06:01:46.142173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b04466e5-10ea-4d9f-afc0-fa9dabe89367 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5cad61f0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:46.199630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b04466e5-10ea-4d9f-afc0-fa9dabe89367 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/19790736-7349-44d4-9067-1c7b7ef896ee" status: 200 len: 351 microversion: 2.1 time: 0.061194 Jun 21 06:01:46.200382 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 509/1002] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:46 2022] GET /compute/v2.1/os-volumes/19790736-7349-44d4-9067-1c7b7ef896ee => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:49.710614 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4594aed7-8d96-4642-a1a3-8aaff0f343b0 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c626160>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:49.717987 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:49.719068 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=42 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:49.762069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4594aed7-8d96-4642-a1a3-8aaff0f343b0 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/52af96ca-857a-4e2a-8d50-09467044fe25" status: 200 len: 351 microversion: 2.1 time: 0.055368 Jun 21 06:01:49.762640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 494/1003] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:49 2022] GET /compute/v2.1/os-volumes/52af96ca-857a-4e2a-8d50-09467044fe25 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:51.145138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:51.146032 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:01:51.150435 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-949de75a-3087-4c7f-9ebc-048e1c421bc1 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c6b88b0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.197110 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-949de75a-3087-4c7f-9ebc-048e1c421bc1 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/4d17199d-a26f-444a-9221-bfd2094c82ca" status: 200 len: 351 microversion: 2.1 time: 0.053150 Jun 21 06:01:51.197660 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 510/1004] 10.222.0.18 () {58 vars in 1244 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes/4d17199d-a26f-444a-9221-bfd2094c82ca => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:51.209538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c2d678c3-7faf-4b45-9cdc-b28115630028 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe60fc9ca0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.289568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c2d678c3-7faf-4b45-9cdc-b28115630028 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084266 Jun 21 06:01:51.290169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 495/1005] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:51.301889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-321339cf-59f9-4ff7-ac80-dee2a8f8c6c3 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c7500d0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.386277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-321339cf-59f9-4ff7-ac80-dee2a8f8c6c3 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086214 Jun 21 06:01:51.386277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 511/1006] 10.222.0.18 () {58 vars in 1148 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:51.398914 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f7eea7e9-1143-4583-a7ac-45d57aadf699 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe60f66550>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.481777 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f7eea7e9-1143-4583-a7ac-45d57aadf699 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.086713 Jun 21 06:01:51.482389 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 496/1007] 10.222.0.18 () {58 vars in 1133 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:51.494615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8e4cba69-68d6-4f6e-aa71-ac81be321f78 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c615430>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.580377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8e4cba69-68d6-4f6e-aa71-ac81be321f78 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090022 Jun 21 06:01:51.581054 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 512/1008] 10.222.0.18 () {58 vars in 1166 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:51.592937 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4d56c3b2-0a8c-4550-a0b9-3e69ca693c87 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c82d040>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.678610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4d56c3b2-0a8c-4550-a0b9-3e69ca693c87 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.089246 Jun 21 06:01:51.679218 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 497/1009] 10.222.0.18 () {58 vars in 1169 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:51.692512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-aca0bde6-2ed3-4297-a247-2c1a685ed0ee tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c7a7310>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.777597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-aca0bde6-2ed3-4297-a247-2c1a685ed0ee tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.088643 Jun 21 06:01:51.782273 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 513/1010] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:01:51.790256 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-b1a4e957-474c-4414-8227-8ed1d2bfbd95 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c631280>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.872928 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-b1a4e957-474c-4414-8227-8ed1d2bfbd95 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087208 Jun 21 06:01:51.873520 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 498/1011] 10.222.0.18 () {58 vars in 1187 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:01:51.884759 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9d67c3d3-d8ee-416d-bd0b-d67c800320b7 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] Calling method '.version_select at 0x7efe5c63edc0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:01:51.964676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9d67c3d3-d8ee-416d-bd0b-d67c800320b7 tempest-VolumesTestJSON-1230882324 tempest-VolumesTestJSON-1230882324-project] 10.222.0.18 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083608 Jun 21 06:01:51.965275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 514/1012] 10.222.0.18 () {58 vars in 1154 bytes} [Tue Jun 21 06:01:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:18.696501 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-68bfaba9-ee07-4eb9-8285-6b1f4d179c0d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Action: 'create', calling method: .version_select at 0x7efe60f665e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1476182596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMGGOLQHRRUSVXRyU2m+PdgairXCsV2V/wninNhS4VgW7gCT5JKGv8c/OB9fzFK8WSS3DK8ULWMTVBeqpGJkVQL1wm5U/qtFSMwdA43bTNDQ6OimlgUE+dzNO5R80Riy+A=="}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:18.728380 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-68bfaba9-ee07-4eb9-8285-6b1f4d179c0d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for project 9405db81e23a4cbbb963f916fbeea605. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 06:02:18.735249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-68bfaba9-ee07-4eb9-8285-6b1f4d179c0d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for user f02739ec12fa4f238244cdcbe1e3d739 and project 9405db81e23a4cbbb963f916fbeea605. Resources: {'key_pairs'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 06:02:18.771702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-68bfaba9-ee07-4eb9-8285-6b1f4d179c0d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.502453 Jun 21 06:02:18.773370 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 499/1013] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 06:02:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:32.419056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9ec0a5bc-82a6-4602-855e-057681ab5636 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Action: 'create', calling method: .version_select at 0x7efe5c7a7b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-439521898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnLQS3LpMy2Fw4+cH3YrlphW/Kp4l5C8rNBYTOR3NGNvcFagv5ARwl5jkh5QSDcyrdlgUSg5oI0q+g8ZhBFP0+WVXaoM7M5SxDfb+yTMBpl7qQC29ZhMJhgLK4hqV+dqg=="}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:32.433547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-9ec0a5bc-82a6-4602-855e-057681ab5636 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Getting quotas for project 391ee53fa68f41a4ac576996b9b52b9d. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 06:02:32.437353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-9ec0a5bc-82a6-4602-855e-057681ab5636 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Getting quotas for user bab1bde41c394c519663217f6466033e and project 391ee53fa68f41a4ac576996b9b52b9d. Resources: {'key_pairs'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 06:02:32.461179 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9ec0a5bc-82a6-4602-855e-057681ab5636 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.047219 Jun 21 06:02:32.463233 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 515/1014] 10.222.0.18 () {60 vars in 1158 bytes} [Tue Jun 21 06:02:32 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:32.562409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=4 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:32.563149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:32.567041 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1422845499", "imageRef": "67032ff5-d3c4-4341-b21b-6e51bd9df53e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-439521898", "networks": [{"uuid": "0aac4482-7ebb-4a44-be12-d0349c93a511"}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:32.585086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:02:32.585290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Tue Jun 21 06:02:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:02:32.621569 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] validate_networks() for [('0aac4482-7ebb-4a44-be12-d0349c93a511', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 06:02:33.017989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 06:02:33.018442 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 06:02:33.018903 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 06:02:33.019303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 06:02:33.019702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 06:02:33.029265 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:33.029703 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:33.030530 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:33.030955 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:33.046924 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Getting quotas for project 391ee53fa68f41a4ac576996b9b52b9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 06:02:33.050822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Getting quotas for user bab1bde41c394c519663217f6466033e and project 391ee53fa68f41a4ac576996b9b52b9d. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 06:02:33.061716 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 06:02:33.065311 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='67032ff5-d3c4-4341-b21b-6e51bd9df53e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 06:02:33.117133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a03d9ba2-6ccd-47c7-b085-609f1f1fba75 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555960 Jun 21 06:02:33.118527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 500/1015] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 06:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 06:02:33.129915 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-997690f7-fded-4fc5-9556-5269842cc735 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:33.131459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-997690f7-fded-4fc5-9556-5269842cc735 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:33.200453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-997690f7-fded-4fc5-9556-5269842cc735 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:33.207231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-997690f7-fded-4fc5-9556-5269842cc735 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1258 microversion: 2.1 time: 0.082668 Jun 21 06:02:33.207787 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 516/1016] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:33 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:34.226252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:34.226872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:34.240293 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:34.241026 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:34.242046 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:34.242493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:34.314130 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:34.329409 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6a8856dc-2c52-48df-885b-8a555369800a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1316 microversion: 2.1 time: 0.107912 Jun 21 06:02:34.330069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 501/1017] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:34 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1316 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:35.352607 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:35.353208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:35.359782 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:35.360239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:35.360976 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:35.361405 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:35.550882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:35.562646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9c7bbb51-3441-4563-ac32-964c4bca36be tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.214354 Jun 21 06:02:35.563348 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 517/1018] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:35 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:36.580055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:36.580857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:36.588346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:36.589296 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:36.590688 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:36.591316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:36.773329 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:36.775217 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1308599344", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1476182596", "security_groups": [{"name": "tempest-secgroup-smoke-1404600577"}], "block_device_mapping_v2": [{"uuid": "00e6af65-cd26-4053-81fe-c3559422e16f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "08118c26-49e5-44b2-ae68-b52c5e4334d2"}]}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:36.781224 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-089a1c2c-e63d-4877-883d-b965a8b2e078 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.204925 Jun 21 06:02:36.782132 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 502/1019] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:36 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:36.908107 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] validate_networks() for [('08118c26-49e5-44b2-ae68-b52c5e4334d2', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 06:02:37.325482 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 06:02:37.325909 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 06:02:37.326420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 06:02:37.326816 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 06:02:37.327231 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 06:02:37.338027 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:37.338724 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:37.339763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:37.340197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:37.366832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for project 9405db81e23a4cbbb963f916fbeea605. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 06:02:37.372535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for user f02739ec12fa4f238244cdcbe1e3d739 and project 9405db81e23a4cbbb963f916fbeea605. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 06:02:37.441634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 06:02:37.444413 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00e6af65-cd26-4053-81fe-c3559422e16f',volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 06:02:37.605499 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-94db27c7-2af8-407b-8806-9c7dd08524db tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.833764 Jun 21 06:02:37.610106 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 518/1020] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 06:02:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 21 06:02:37.616631 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-572a1701-c440-4d36-98b6-d163cb7286b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:37.617234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-572a1701-c440-4d36-98b6-d163cb7286b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:37.700852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-572a1701-c440-4d36-98b6-d163cb7286b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:37.710467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-572a1701-c440-4d36-98b6-d163cb7286b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1095 microversion: 2.1 time: 0.097682 Jun 21 06:02:37.711348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 503/1021] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:37 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:02:37.799346 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:37.799956 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:37.807707 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:37.810347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:37.811418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:37.812047 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:38.052305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:38.062059 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-14decd7e-81ac-491e-8c63-867b980bda91 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.266274 Jun 21 06:02:38.063041 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 519/1022] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:37 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:38.729039 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:38.729661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:38.736839 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:38.737284 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:38.738079 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:38.738512 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:38.806321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:38.825400 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0c324e5a-b430-49ad-afba-485798ce4ff2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1145 microversion: 2.1 time: 0.100193 Jun 21 06:02:38.825998 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 504/1023] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:38 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:39.079382 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:39.079994 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:39.087437 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:39.087882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:39.088640 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:39.089071 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:39.239347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:39.246848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-61530623-e445-41bd-8cb5-ee05fe604e56 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.171284 Jun 21 06:02:39.247412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 520/1024] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:39 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:39.844577 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:39.845314 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:39.853907 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:39.854398 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:39.855275 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:39.855712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:39.921333 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:39.943081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-feeb6b63-f002-415f-af07-7e9b0302a29e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1145 microversion: 2.1 time: 0.103303 Jun 21 06:02:39.943979 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 505/1025] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:39 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:40.264633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:40.265198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:40.275904 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:40.276358 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:40.277432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:40.277876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:40.434134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:40.443292 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f9dc16a3-601e-4962-b7f8-05248a35ce83 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.182648 Jun 21 06:02:40.444195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 521/1026] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:40 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:40.966460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:40.967028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:40.974841 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:40.975634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:40.976736 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:40.977406 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:41.049710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:41.058170 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ede2393d-65ca-470b-abd1-3cc77fc28fcc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1145 microversion: 2.1 time: 0.095544 Jun 21 06:02:41.058921 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 506/1027] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:40 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:41.460377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:41.460987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:41.468702 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:41.469253 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:41.470338 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:41.471180 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:41.621776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:41.629662 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5343d2f8-f070-40e8-80a7-c527125e0c7d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.173183 Jun 21 06:02:41.630331 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 522/1028] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:41 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:42.075585 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:42.076260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:42.083743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:42.084206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:42.085035 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:42.085472 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:42.157907 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:42.165830 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7873603f-3c38-4507-9b5c-fe1901878f3d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1145 microversion: 2.1 time: 0.094214 Jun 21 06:02:42.166445 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 507/1029] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:42 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1145 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:02:42.646738 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:42.647402 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:42.654173 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:42.654616 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:42.655963 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:42.655963 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:42.788222 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:42.796003 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ba0fc478-bf3e-4370-ba19-be35bb40792f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.153242 Jun 21 06:02:42.796563 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 523/1030] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:42 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:43.183075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:43.183669 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:43.185659 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:43.191743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:43.192258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:43.193333 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:43.194003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:43.265366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:43.275400 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d03b0c30-441b-4b5d-83cc-258e8f4a2c59 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1193 microversion: 2.1 time: 0.095959 Jun 21 06:02:43.276055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 508/1031] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:43 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:43.554706 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-80fda4fc-0e54-423a-9e3f-1abba69c4893 req-93d37ed5-8604-4288-be17-fd6786386b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:43.580461 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-80fda4fc-0e54-423a-9e3f-1abba69c4893 req-93d37ed5-8604-4288-be17-fd6786386b24 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:43.580858 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-80fda4fc-0e54-423a-9e3f-1abba69c4893 req-93d37ed5-8604-4288-be17-fd6786386b24 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:43.596526 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-80fda4fc-0e54-423a-9e3f-1abba69c4893 req-93d37ed5-8604-4288-be17-fd6786386b24 service nova] Creating event network-changed:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:02:43.603377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-80fda4fc-0e54-423a-9e3f-1abba69c4893 req-93d37ed5-8604-4288-be17-fd6786386b24 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052514 Jun 21 06:02:43.604577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 524/1032] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:43.812870 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:43.813575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:43.820730 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:43.821196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:43.822236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:43.822850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.035092 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:44.043798 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-99be86bc-462a-4804-8708-09c9c473438d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.234904 Jun 21 06:02:44.054593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 509/1033] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:43 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:44.307002 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:44.308989 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:44.317961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.318812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.319824 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.320615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.422241 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:44.430457 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-47620e96-97b9-4600-bb0f-9e71d157fac7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1199 microversion: 2.1 time: 0.140700 Jun 21 06:02:44.439790 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 525/1034] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:44 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1199 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:44.747742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-ed21d4e9-a842-402e-b6f9-cbc193997269 req-e5a0f2cd-f3f5-4313-a829-7bb9a85d81b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:44.753148 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:44.753656 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:44.762281 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.762732 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.763502 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.763934 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.767634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ed21d4e9-a842-402e-b6f9-cbc193997269 req-e5a0f2cd-f3f5-4313-a829-7bb9a85d81b8 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.768131 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-ed21d4e9-a842-402e-b6f9-cbc193997269 req-e5a0f2cd-f3f5-4313-a829-7bb9a85d81b8 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.783043 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-ed21d4e9-a842-402e-b6f9-cbc193997269 req-e5a0f2cd-f3f5-4313-a829-7bb9a85d81b8 service nova] Creating event network-changed:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 06:02:44.790732 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-ed21d4e9-a842-402e-b6f9-cbc193997269 req-e5a0f2cd-f3f5-4313-a829-7bb9a85d81b8 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045848 Jun 21 06:02:44.791664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 526/1035] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:44.795215 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:02:44.892049 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5dbe9fab-6f01-465d-863a-40706d8d3a35 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "DELETE /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 204 len: 0 microversion: 2.1 time: 0.149903 Jun 21 06:02:44.893014 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 510/1036] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:02:44 2022] DELETE /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:02:44.903885 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:44.904588 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:44.913874 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.914661 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:44.915617 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:44.916432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:45.063290 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:45.064311 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:45.073258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:45.074034 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:45.075801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:45.076439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:45.095870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:45.108263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1f7bd9a4-9308-45d2-81b0-c7f47b96b2d2 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.209519 Jun 21 06:02:45.121045 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 527/1037] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:44 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:45.226451 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:45.237596 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bc5d805e-0a5c-4602-af6d-bf1cf9d266ee tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.180527 Jun 21 06:02:45.238794 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 511/1038] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:45 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:02:45.449567 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:45.450216 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:45.460364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:45.461298 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:45.463420 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:45.464315 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:45.633181 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:45.644692 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8680fe25-ffe6-448e-87c0-0754f5aaa9eb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.200999 Jun 21 06:02:45.646748 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 528/1039] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:45 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:46.127976 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:46.129279 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:46.137327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.138176 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.139475 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.139884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.195981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-f5eacf00-4352-4aaa-b4f2-adfa7b1ad629 req-f5b1cc27-04be-43ed-aa29-9e65650e0746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939ccd30-4a20-413b-82e8-808b352cb342", "tag": "47194ebb-2e6b-49a5-89ce-156374a9f988"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:46.211996 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-f5eacf00-4352-4aaa-b4f2-adfa7b1ad629 req-f5b1cc27-04be-43ed-aa29-9e65650e0746 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.212910 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-f5eacf00-4352-4aaa-b4f2-adfa7b1ad629 req-f5b1cc27-04be-43ed-aa29-9e65650e0746 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.233145 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-f5eacf00-4352-4aaa-b4f2-adfa7b1ad629 req-f5b1cc27-04be-43ed-aa29-9e65650e0746 service nova] Creating event network-changed:47194ebb-2e6b-49a5-89ce-156374a9f988 for instance 939ccd30-4a20-413b-82e8-808b352cb342 on hv-cinder-84690 Jun 21 06:02:46.247765 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-f5eacf00-4352-4aaa-b4f2-adfa7b1ad629 req-f5b1cc27-04be-43ed-aa29-9e65650e0746 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055846 Jun 21 06:02:46.248748 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 529/1040] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:46.272764 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:46.274157 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:46.285672 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.286879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.287854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.288505 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.326460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:46.338811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a2b2b249-e5bc-40a7-ab2e-b5d4f8e9030f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.214643 Jun 21 06:02:46.339391 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 512/1041] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:46 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:46.435771 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:46.443886 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bc0f4f4d-a26d-49bc-8f94-f2f9f1cf66b6 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.186904 Jun 21 06:02:46.444451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 530/1042] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:46 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:46.662152 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:46.663703 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:46.672197 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.673592 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.674643 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:46.675158 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:46.878835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:46.887338 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e17672b7-d9a6-4ded-a6c5-4ceeba08fada tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.229056 Jun 21 06:02:46.887919 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 513/1043] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:46 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:47.356547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:47.357159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:47.359547 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:47.365624 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:47.366097 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:47.366867 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:47.367290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:47.382774 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=12 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:47.460881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:47.461792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:47.477732 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:47.478331 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:47.479220 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:47.479726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:47.540047 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:47.552947 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4f44d0ed-0005-4cfa-8742-52020d214cf5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.198090 Jun 21 06:02:47.553998 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 531/1044] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:47 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:47.652366 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:47.660252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-46fedc48-4f0a-4e2d-8fab-94a3f4cfaee5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.203175 Jun 21 06:02:47.669880 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 514/1045] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:47 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:47.905286 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:47.906690 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:47.915927 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:47.916379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:47.917152 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:47.917579 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:48.057636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:48.065517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-850e6f83-cfd0-4345-b643-5da3ed412ed7 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.164950 Jun 21 06:02:48.066138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 532/1046] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:47 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:48.570839 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:48.571464 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:48.573395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=8 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:48.580177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:48.580665 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:48.581438 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:48.581864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:48.677351 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:48.677980 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:48.685752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:48.686250 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:48.687019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:48.687448 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:48.720349 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:48.728881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a618f134-712a-4831-9d89-d8e5faea4e6f tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.162587 Jun 21 06:02:48.729462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 515/1047] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:48 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:48.820507 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:48.828057 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9f7692ec-67d9-41ef-9a2b-b3be0ffde051 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.154522 Jun 21 06:02:48.828553 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 533/1048] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:48 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:02:49.083854 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:49.084368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:49.090663 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.091098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.091852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.092277 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.257481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:49.372604 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:49.380110 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6f11dbda-4c76-4bcd-879c-31e62800717d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.300831 Jun 21 06:02:49.380668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 516/1049] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:49 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:49.591555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-4e14d0bc-630a-4505-be62-e9cb6f924fa9 req-f00d5ba6-77f7-4010-830a-8942183d0d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "name": "network-vif-plugged", "status": "completed", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:49.599676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-4e14d0bc-630a-4505-be62-e9cb6f924fa9 req-f00d5ba6-77f7-4010-830a-8942183d0d94 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.600113 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-4e14d0bc-630a-4505-be62-e9cb6f924fa9 req-f00d5ba6-77f7-4010-830a-8942183d0d94 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.611840 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-4e14d0bc-630a-4505-be62-e9cb6f924fa9 req-f00d5ba6-77f7-4010-830a-8942183d0d94 service nova] Creating event network-vif-plugged:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:02:49.616851 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-4e14d0bc-630a-4505-be62-e9cb6f924fa9 req-f00d5ba6-77f7-4010-830a-8942183d0d94 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029095 Jun 21 06:02:49.617455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 534/1050] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:49.746321 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:49.747022 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:49.753441 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.753999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.755286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.756351 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.848378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:49.849084 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:49.855340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.855796 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.856577 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:49.857009 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:49.890452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:49.898344 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a699df47-596c-40e3-8aed-901b0b347343 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.155840 Jun 21 06:02:49.898922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 517/1051] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:49 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:49.993019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:50.000907 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cbad8f26-a360-4bec-817a-5f5bad67bd8b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.157253 Jun 21 06:02:50.001572 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 535/1052] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:49 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:50.396729 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:50.397328 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:50.403328 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:50.403792 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:50.404549 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:50.404977 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:50.804111 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:50.811720 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0a4d7a71-f617-4ce0-b5d8-bc785367ae07 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.418869 Jun 21 06:02:50.812273 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 518/1053] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:50 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:50.916488 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:50.917035 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:50.923447 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:50.923883 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:50.924634 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:50.925059 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:51.021861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:51.021861 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:51.026752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:51.027226 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:51.028166 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:51.028607 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:51.059834 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:51.063355 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=100 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:51.068965 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-170edc3d-29b6-4799-b2bc-b2987f4bb82c tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.156421 Jun 21 06:02:51.069543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 536/1054] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:50 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:51.161703 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:51.169188 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-753a1172-1b1c-46fa-a2e8-92191f85f5fc tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.154569 Jun 21 06:02:51.169672 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 519/1055] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:51 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:51.639218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-750073b8-48ef-4424-aeb1-68828250d5f7 req-1d6c3b42-d6f3-4bae-aa68-ca708a67d21e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "name": "network-vif-unplugged", "status": "completed", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:51.647458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-750073b8-48ef-4424-aeb1-68828250d5f7 req-1d6c3b42-d6f3-4bae-aa68-ca708a67d21e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:51.647901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-750073b8-48ef-4424-aeb1-68828250d5f7 req-1d6c3b42-d6f3-4bae-aa68-ca708a67d21e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:51.661658 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-750073b8-48ef-4424-aeb1-68828250d5f7 req-1d6c3b42-d6f3-4bae-aa68-ca708a67d21e service nova] Creating event network-vif-unplugged:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 06:02:51.666653 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-750073b8-48ef-4424-aeb1-68828250d5f7 req-1d6c3b42-d6f3-4bae-aa68-ca708a67d21e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031102 Jun 21 06:02:51.667260 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 537/1056] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:51.828692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:51.829295 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:51.835822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:51.836552 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:51.837316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:51.837756 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:51.968956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:51.976960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6028cfe6-b997-45be-b399-934ef3595fd3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.152211 Jun 21 06:02:51.977514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 520/1057] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:51 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:52.088064 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:52.088829 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:52.095478 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:52.095917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:52.096684 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:52.097101 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:52.185878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:52.186534 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:52.192685 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:52.193129 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:52.193900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:52.194355 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:52.243337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:52.250968 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bab9c3df-4457-45dd-9b62-f8af99b5ee60 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.168692 Jun 21 06:02:52.251533 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 538/1058] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:52 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:52.327100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:52.335852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cfed52dc-b6ed-41aa-94f7-7eeb203ee574 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.153882 Jun 21 06:02:52.336700 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 521/1059] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:52 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:52.994238 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:52.994766 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:53.000838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:53.001287 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:53.002075 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:53.002513 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:53.137090 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:53.144855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ff63d0a9-bee1-4586-9033-4cabbd29ed7e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.154551 Jun 21 06:02:53.145791 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 539/1060] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:52 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:53.268286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:53.268816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:53.275368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:53.275804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:53.276558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:53.276985 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:53.352525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:53.353142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:53.359396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:53.359855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:53.360623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:53.361058 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:53.443842 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:53.451828 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-005f7948-a052-4c47-818a-079c3ba84ca5 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.187430 Jun 21 06:02:53.452398 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 522/1061] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:53 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:53.505535 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:53.513079 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-19b4ed9f-9ce5-4264-9c8a-0a8232bae550 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.165022 Jun 21 06:02:53.513650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 540/1062] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:53 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:02:54.161057 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:54.161653 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:54.168053 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:54.168494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:54.169272 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:54.169708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:54.315956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:54.325388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-aa501961-df8b-4fa8-a10a-644d333e40b6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.168221 Jun 21 06:02:54.325988 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 523/1063] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:54 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:54.469546 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:54.470183 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:54.478022 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:54.478463 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:54.479228 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:54.479654 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:54.531628 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:54.532347 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:54.540054 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:54.541003 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:54.541382 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:54.541827 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:54.800016 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:54.808752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-60000623-7185-4a05-8a0a-5ec5c7bdcabb tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1567 microversion: 2.1 time: 0.342862 Jun 21 06:02:54.809347 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 541/1064] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:54 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1567 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:54.828804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:54.837779 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1118003c-94fd-45ea-9490-39efef2fc10c tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.312714 Jun 21 06:02:54.838394 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 524/1065] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:54 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:55.343125 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:55.343730 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:55.349854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.350326 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.351117 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.351524 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.497268 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:55.505775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b06c899c-471a-4f38-a233-67b1304b411e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.166536 Jun 21 06:02:55.506497 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 542/1066] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:55 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:55.746593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-934c2abb-099e-4520-b4ab-5ca9aa21f103 req-b7ee73c9-8287-49bc-ac30-fda083323f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637283de-f095-41ed-97d1-0270fd8adb7e", "name": "network-vif-deleted", "tag": "9ed1f916-c5d3-484b-8fd1-8aad68c59930"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:55.755881 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-934c2abb-099e-4520-b4ab-5ca9aa21f103 req-b7ee73c9-8287-49bc-ac30-fda083323f23 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.756418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-934c2abb-099e-4520-b4ab-5ca9aa21f103 req-b7ee73c9-8287-49bc-ac30-fda083323f23 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.768636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-934c2abb-099e-4520-b4ab-5ca9aa21f103 req-b7ee73c9-8287-49bc-ac30-fda083323f23 service nova] Creating event network-vif-deleted:9ed1f916-c5d3-484b-8fd1-8aad68c59930 for instance 637283de-f095-41ed-97d1-0270fd8adb7e on hv-cinder-84690 Jun 21 06:02:55.774196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-934c2abb-099e-4520-b4ab-5ca9aa21f103 req-b7ee73c9-8287-49bc-ac30-fda083323f23 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031546 Jun 21 06:02:55.774804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 525/1067] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:55.826763 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:55.827396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:55.834163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.834612 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.835378 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.835813 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.854959 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:55.855743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:55.865191 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.865896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.866886 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:55.867494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:55.902308 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:55.911429 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-38661d45-10ff-4798-b566-e4fb11e4bc64 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1219 microversion: 2.1 time: 0.088517 Jun 21 06:02:55.912436 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 543/1068] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:55 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:56.008096 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:56.016364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c42ab007-fbe7-4b14-a77d-d44e8dfef487 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1358 microversion: 2.1 time: 0.165447 Jun 21 06:02:56.017255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 526/1069] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:55 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:02:56.523333 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:56.523951 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:56.530795 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:56.531244 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:56.532018 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:56.532458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:56.699589 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:56.708532 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3709d985-a447-45de-9ac8-7d31d78ee106 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.189592 Jun 21 06:02:56.709132 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 544/1070] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:56 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:56.928849 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:56.929446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:56.936154 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:56.936602 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:56.937377 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:56.937816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:56.970970 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:56.971413 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:56.971863 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lazy-loading 'fault' on Instance uuid 637283de-f095-41ed-97d1-0270fd8adb7e {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:02:57.014100 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '353add140e784d90a16c124e52f5d36d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e17d31f99954cca8b4eb24b3b798f1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:57.021516 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-52f03cda-2d0d-4b85-a2d5-07b40f82f3e8 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 200 len: 1178 microversion: 2.1 time: 0.097272 Jun 21 06:02:57.022121 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 527/1071] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:56 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 1178 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:57.033704 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:57.034374 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:57.040876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.041340 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.042142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.042573 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.171946 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:57.179364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c86af631-c0d3-4afe-9b1d-5765726081c5 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1549 microversion: 2.1 time: 0.149442 Jun 21 06:02:57.179926 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 545/1072] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:57 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:57.195571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:57.196171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:57.202133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.202577 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.203325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.203752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.335843 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:57.343446 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-80648846-ddcb-4d7b-9b12-78f1cdb73654 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1549 microversion: 2.1 time: 0.152206 Jun 21 06:02:57.343995 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 528/1073] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:57 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:57.358571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:57.362001 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:57.362780 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Searching by: {'deleted': False, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d'} {{(pid=117431) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 21 06:02:57.369859 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.370330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.371108 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.371527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.459959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.multi_cell_list [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117431) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 21 06:02:57.552320 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c58f4d59-47bd-48be-b628-a45885f0b662 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197345 Jun 21 06:02:57.552977 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 546/1074] 10.222.0.18 () {58 vars in 1124 bytes} [Tue Jun 21 06:02:57 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:02:57.563325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:57.563938 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:57.570985 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.571437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.572202 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.572640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.704782 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:57.712847 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9a71591e-067c-432d-883f-f0fc9ba11b65 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1549 microversion: 2.1 time: 0.153339 Jun 21 06:02:57.713372 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 529/1075] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:57 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:57.726625 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:57.727301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:57.733419 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.733857 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.734650 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:57.735075 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:57.883193 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:57.890722 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1fd366ff-2a98-4b1b-a55b-f36c4bd2f072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.168759 Jun 21 06:02:57.891284 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 547/1076] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:57 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:58.038907 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:58.039710 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] [instance: 637283de-f095-41ed-97d1-0270fd8adb7e] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:58.046623 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:58.047348 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:58.048972 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:58.049640 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:58.065158 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] HTTP exception thrown: Instance 637283de-f095-41ed-97d1-0270fd8adb7e could not be found. Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Request method failure captured: Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e HTTP/1.1 Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV22BBknoB3LU5krJ6GFd0xJMXtNVz4Cdsbr7IPOjFRcpRzUCkha2i_3NZ6kTNZnOPkcmdR8VIO09o5-yKg6qX1cme5onzMSYKypqmFnZ593_fmCjt6lOo2zezbbVQabWeJvw54sEXWCGufcSXCqCrB5xE3S5Czt0ZR4n5A0SHKA7JQ Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 4e17d31f99954cca8b4eb24b3b798f1e Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-TestShelveInstance-760571228 Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:02:58.067089 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4e17d31f99954cca8b4eb24b3b798f1e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/4e17d31f99954cca8b4eb24b3b798f1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_4e17d31f99954cca8b4eb24b3b798f1e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/4e17d31f99954cca8b4eb24b3b798f1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-TestShelveInstance-760571228 Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 4e17d31f99954cca8b4eb24b3b798f1e Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-TestShelveInstance-760571228 Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-TestShelveInstance-760571228-project Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: 353add140e784d90a16c124e52f5d36d Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-TestShelveInstance-760571228-project Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 637283de-f095-41ed-97d1-0270fd8adb7e could not be found. Jun 21 06:02:58.069183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '637283de-f095-41ed-97d1-0270fd8adb7e'} Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637283de-f095-41ed-97d1-0270fd8adb7e could not be found. Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:02:58.070271 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637283de-f095-41ed-97d1-0270fd8adb7e could not be found. Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637283de-f095-41ed-97d1-0270fd8adb7e could not be found. Jun 21 06:02:58.071885 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:02:58.073629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Returning 404 to user: Instance 637283de-f095-41ed-97d1-0270fd8adb7e could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:02:58.073629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-66a6e2a5-4cd9-415e-84ac-1b15c78b40a0 tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e" status: 404 len: 111 microversion: 2.1 time: 0.034482 Jun 21 06:02:58.073629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 530/1077] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:58 2022] GET /compute/v2.1/servers/637283de-f095-41ed-97d1-0270fd8adb7e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:02:58.230221 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3f5a34d9-1c87-4eca-a54d-cdc7750d54aa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] Calling method '.version_select at 0x7efe5c5b98b0>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:58.248239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3f5a34d9-1c87-4eca-a54d-cdc7750d54aa tempest-TestShelveInstance-760571228 tempest-TestShelveInstance-760571228-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1550044513" status: 202 len: 0 microversion: 2.1 time: 0.021819 Jun 21 06:02:58.248864 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 548/1078] 10.222.0.18 () {58 vars in 1253 bytes} [Tue Jun 21 06:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1550044513 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 21 06:02:58.909868 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:02:58.911666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:58.924274 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:58.925140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:58.927670 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:58.928364 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:59.194365 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:02:59.201595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-245a823d-1f9d-4ac4-b3d7-ad0ac0f58116 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.297180 Jun 21 06:02:59.202195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 531/1079] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:02:58 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:02:59.246493 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "342829f4-083e-4c3e-8a49-56df446665ed"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:02:59.247544 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:02:59.250517 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:02:59.254647 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:59.255095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:59.255865 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:02:59.256293 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:02:59.524425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-133f5878-23a4-44fd-9a03-88f46452cd9e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282049 Jun 21 06:02:59.525281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 549/1080] 10.222.0.18 () {60 vars in 1322 bytes} [Tue Jun 21 06:02:59 2022] POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:03:00.219171 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:00.219816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:00.227747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:00.229994 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:00.231052 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:00.231661 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:00.404647 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:00.413628 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5183ab6d-d4a9-4f80-b5e9-6671e416b45a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.198741 Jun 21 06:03:00.414297 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 532/1081] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:00 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:01.431668 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:01.432364 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:01.449833 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:01.450305 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:01.451083 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:01.451511 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:01.655608 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:01.665714 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-71702ff7-a4b0-4c59-a092-a9a013801180 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.238513 Jun 21 06:03:01.677893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 550/1082] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:01 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:02.686149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:02.687325 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:02.689892 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:02.709222 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:02.709724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:02.711165 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:02.711783 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:02.916835 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:02.924529 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5966f26e-fe62-4cc2-a7c6-c5780c227906 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.243397 Jun 21 06:03:02.925025 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 533/1083] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:02 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:03.940500 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:03.941480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:03.948138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:03.948578 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:03.949342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:03.949960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:04.170691 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:04.178230 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-b396d530-f714-4cc2-ba42-974ab0e396ac tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.241537 Jun 21 06:03:04.178884 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 551/1084] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:03 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:05.195262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:05.195986 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:05.207953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:05.208436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:05.210156 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:05.211327 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:05.221790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=100 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:05.358028 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:05.366429 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1368792f-1bb6-43c6-be18-bae4de07cc30 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.175530 Jun 21 06:03:05.367134 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 534/1085] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:05 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:06.384391 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:06.385015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:06.392176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:06.392622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:06.393398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:06.394011 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:06.564555 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:06.573345 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f8fd6f6b-06dc-46fa-81c8-95daea28e78b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.192826 Jun 21 06:03:06.574248 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 552/1086] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:06 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:07.590242 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:07.590850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:07.597926 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:07.598401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:07.599166 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:07.599598 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:07.738330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:07.745966 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-58eaabb6-bd57-4af0-a5a8-3eaa631e3d1b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.159816 Jun 21 06:03:07.746541 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 535/1087] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:07 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:08.267832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:08.268454 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:08.271432 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:08.277176 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:08.277621 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:08.278427 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:08.278853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:08.286126 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-5c05ef5d-1b5e-4ca1-bf7e-933c9ccf6a80 req-6881d5cf-1369-4fa7-9801-ca3eeccecbd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939ccd30-4a20-413b-82e8-808b352cb342", "name": "network-vif-plugged", "status": "completed", "tag": "47194ebb-2e6b-49a5-89ce-156374a9f988"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:03:08.294388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-5c05ef5d-1b5e-4ca1-bf7e-933c9ccf6a80 req-6881d5cf-1369-4fa7-9801-ca3eeccecbd1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:08.294822 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-5c05ef5d-1b5e-4ca1-bf7e-933c9ccf6a80 req-6881d5cf-1369-4fa7-9801-ca3eeccecbd1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:08.298072 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:08.307857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-5c05ef5d-1b5e-4ca1-bf7e-933c9ccf6a80 req-6881d5cf-1369-4fa7-9801-ca3eeccecbd1 service nova] Creating event network-vif-plugged:47194ebb-2e6b-49a5-89ce-156374a9f988 for instance 939ccd30-4a20-413b-82e8-808b352cb342 on hv-cinder-84690 Jun 21 06:03:08.313374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-5c05ef5d-1b5e-4ca1-bf7e-933c9ccf6a80 req-6881d5cf-1369-4fa7-9801-ca3eeccecbd1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030859 Jun 21 06:03:08.314584 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 536/1088] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:03:08.414657 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:08.422705 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-850049f8-4fa3-4056-8cf7-bf22c28b49e0 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1595 microversion: 2.1 time: 0.158828 Jun 21 06:03:08.423274 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 553/1089] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:08 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:08.763780 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:08.764607 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:08.771583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:08.772151 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:08.772999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:08.773515 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:08.919057 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:08.929186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e595d202-19b2-4b28-b293-cd80aab86fe9 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1267 microversion: 2.1 time: 0.169899 Jun 21 06:03:08.930443 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 537/1090] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:08 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:09.949956 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:09.950677 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:09.957618 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:09.958190 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:09.959024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:09.959529 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:10.100085 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:10.108056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1d05e048-a4c5-47da-a5b3-224a03588c34 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1455 microversion: 2.1 time: 0.164163 Jun 21 06:03:10.115637 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 554/1091] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:09 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1455 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:10.124176 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:10.124884 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:10.131450 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:10.131900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:10.132659 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:10.133091 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:10.269958 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:10.278999 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4aff7a06-da04-43ab-88ee-4fbf44dae22e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1455 microversion: 2.1 time: 0.158453 Jun 21 06:03:10.279921 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 538/1092] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:10 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:10.510685 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-af85aea7-326b-4ece-b2b8-36cb40468b2d req-f03a9dc6-e0c3-4643-abf8-f349d30cb95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:03:10.520727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-af85aea7-326b-4ece-b2b8-36cb40468b2d req-f03a9dc6-e0c3-4643-abf8-f349d30cb95e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:10.521088 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-af85aea7-326b-4ece-b2b8-36cb40468b2d req-f03a9dc6-e0c3-4643-abf8-f349d30cb95e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:10.533294 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-af85aea7-326b-4ece-b2b8-36cb40468b2d req-f03a9dc6-e0c3-4643-abf8-f349d30cb95e service nova] Creating event network-changed:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:03:10.539458 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-af85aea7-326b-4ece-b2b8-36cb40468b2d req-f03a9dc6-e0c3-4643-abf8-f349d30cb95e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032104 Jun 21 06:03:10.540514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 555/1093] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:03:12.362570 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2142358567"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:03:12.363140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:12.369790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:12.370277 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:12.371055 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:12.371494 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:12.586866 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.network.security_group_api [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Adding security group fbbdceeb-a7fd-4b8f-ac22-251cf43c5a8d to port a794b84b-dcfe-4fe5-aba5-ed6f81620df8 Jun 21 06:03:12.943444 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-a9d32176-3f4a-4802-81cc-995fb116956f req-596d50b5-2ace-457b-9455-1f58a8ae738e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939ccd30-4a20-413b-82e8-808b352cb342", "tag": "47194ebb-2e6b-49a5-89ce-156374a9f988"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:03:12.953252 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a9d32176-3f4a-4802-81cc-995fb116956f req-596d50b5-2ace-457b-9455-1f58a8ae738e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:12.953854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-a9d32176-3f4a-4802-81cc-995fb116956f req-596d50b5-2ace-457b-9455-1f58a8ae738e service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:12.966443 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-a9d32176-3f4a-4802-81cc-995fb116956f req-596d50b5-2ace-457b-9455-1f58a8ae738e service nova] Creating event network-changed:47194ebb-2e6b-49a5-89ce-156374a9f988 for instance 939ccd30-4a20-413b-82e8-808b352cb342 on hv-cinder-84690 Jun 21 06:03:12.972186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-a9d32176-3f4a-4802-81cc-995fb116956f req-596d50b5-2ace-457b-9455-1f58a8ae738e service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035281 Jun 21 06:03:12.972987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 556/1094] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:03:13.128428 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7468382c-b725-40af-8026-921c18470c77 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/action" status: 202 len: 0 microversion: 2.1 time: 0.769827 Jun 21 06:03:13.129739 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 539/1095] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 06:03:12 2022] POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:03:13.138525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:13.139235 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:13.149408 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:13.150217 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:13.151235 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:13.156735 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:13.411090 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:13.420138 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6d989d28-83f6-4b08-9d7b-e7d1e558ed18 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1761 microversion: 2.1 time: 0.285918 Jun 21 06:03:13.421666 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 557/1096] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:13 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1761 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:14.993013 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-19ac7864-5f6c-4899-ae19-1af9eca2ef9a req-c3d91995-4215-43f1-a5ba-ee8b9eb1f011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:03:15.001206 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-19ac7864-5f6c-4899-ae19-1af9eca2ef9a req-c3d91995-4215-43f1-a5ba-ee8b9eb1f011 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:15.001648 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-19ac7864-5f6c-4899-ae19-1af9eca2ef9a req-c3d91995-4215-43f1-a5ba-ee8b9eb1f011 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:15.012400 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-19ac7864-5f6c-4899-ae19-1af9eca2ef9a req-c3d91995-4215-43f1-a5ba-ee8b9eb1f011 service nova] Creating event network-changed:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:03:15.017362 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-19ac7864-5f6c-4899-ae19-1af9eca2ef9a req-c3d91995-4215-43f1-a5ba-ee8b9eb1f011 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029121 Jun 21 06:03:15.017945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 540/1097] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:03:35.949924 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:03:35.950889 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:35.953527 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=16 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:35.954201 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=18 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:35.962357 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:35.962802 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:35.963568 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:35.964020 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:36.041134 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a7cae3d2-f010-4d45-9085-93586d559993 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/action" status: 202 len: 0 microversion: 2.1 time: 0.094939 Jun 21 06:03:36.041917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 558/1098] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 06:03:35 2022] POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:03:36.052075 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=15 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:36.054151 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=30 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:03:36.062878 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:36.064258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:36.073561 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:36.074018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:36.074798 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:36.075236 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:36.229732 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:36.239051 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bdc98e6e-1191-44bc-b6be-88749274be66 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1753 microversion: 2.1 time: 0.190615 Jun 21 06:03:36.239726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 541/1099] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:36 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:37.257855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:37.258570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:37.264717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:37.265159 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:37.265901 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:37.266346 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:37.406774 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:37.414882 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-24c151a8-dc99-4611-83d9-0a74944416bb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.162211 Jun 21 06:03:37.415453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 559/1100] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:37 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:38.432069 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:38.432657 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:38.439219 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:38.439668 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:38.440427 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:38.440862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:38.588135 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:38.596072 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-04b02b47-a468-4181-96b8-3ff15c2ad52e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.167962 Jun 21 06:03:38.596702 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 542/1101] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:38 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:39.613341 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:39.613997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:39.620408 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:39.620847 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:39.621597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:39.622056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:39.760979 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:39.769414 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-9ac86678-c490-469f-840f-521ae14e1265 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.160508 Jun 21 06:03:39.769991 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 560/1102] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:39 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:40.787690 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:40.788303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:40.794900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:40.795345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:40.796120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:40.796558 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:40.946174 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:40.954164 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3e1e2f4a-8065-43b7-861b-692b2dc84ac8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.170976 Jun 21 06:03:40.954724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 543/1103] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:40 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:41.972480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:41.973086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:41.979591 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:41.980030 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:41.980775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:41.981219 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:42.123934 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:42.131921 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-afdc85dd-7c8f-4c00-b965-adf1ffe7aa7e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.163933 Jun 21 06:03:42.132480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 561/1104] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:41 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:43.150337 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:43.151138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:43.157467 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:43.157905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:43.158677 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:43.159123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:43.297480 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:43.306095 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-31a700c2-325b-47cb-bcca-1a64852c2df9 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.160564 Jun 21 06:03:43.306864 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 544/1105] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:43 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:44.323051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:44.323717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:44.330151 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:44.331087 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:44.331853 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:44.332283 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:44.480306 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:44.488576 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a5156391-ec80-446d-9d5b-f386eaf5760d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.169334 Jun 21 06:03:44.489158 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 562/1106] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:44 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:45.506045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:45.506595 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:45.513140 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:45.513583 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:45.514368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:45.514827 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:45.658352 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:45.666801 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-80a5ed4c-774f-4c02-8cd8-9534c7ebb26b tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.164744 Jun 21 06:03:45.667359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 545/1107] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:45 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:46.683659 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:46.684272 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:46.691827 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:46.692150 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:46.692917 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:46.693392 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:46.839949 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:46.847959 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a348d93c-80b2-42f9-bdb8-d5e8231af84f tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.168089 Jun 21 06:03:46.848540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 563/1108] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:46 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:47.868932 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:47.869603 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:47.876622 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:47.877058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:47.877850 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:47.878298 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:48.035345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:48.043764 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-3c9c955d-a85f-4529-8c07-a10dc3009c07 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.178674 Jun 21 06:03:48.044369 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 546/1109] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:47 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:49.061484 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:49.062128 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:49.069169 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:49.069609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:49.070399 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:49.070826 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:49.213543 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:49.223496 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-cda94b2c-b555-40cd-abab-2cdecf9a6b23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.165879 Jun 21 06:03:49.224071 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 564/1110] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:49 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:50.241964 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:50.242557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:50.249287 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:50.250793 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:50.250793 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:50.251946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:50.517511 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:50.525542 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-a9ccfb25-5d1d-4ac0-a3c2-2ccfd280faf8 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.288752 Jun 21 06:03:50.526151 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 547/1111] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:50 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:51.542871 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:51.543459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:51.551133 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:51.551575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:51.552349 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:51.552776 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:51.696226 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:51.704376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-88a7c140-0922-4b49-abf6-ac805484a6aa tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.165729 Jun 21 06:03:51.704961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 565/1112] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:51 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:03:52.723466 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:52.724229 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:52.731997 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:52.732619 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:52.733858 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:52.734517 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:52.896813 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:52.905115 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c0ebab48-28e8-4d0c-a91d-de1a725782e1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1758 microversion: 2.1 time: 0.186280 Jun 21 06:03:52.905726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 548/1113] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:52 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1758 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:03:53.923820 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:03:53.924442 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:03:53.932005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:53.932453 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:53.933239 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:03:53.933674 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:03:54.142203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:03:54.151646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-003c30e9-ae1c-48a6-8d35-dfea84c4cdd4 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1761 microversion: 2.1 time: 0.231816 Jun 21 06:03:54.153773 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 566/1114] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:03:53 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1761 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:04:26.358283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2142358567"}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:04:26.358990 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:26.361105 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=16 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:26.361770 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=48 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:26.368200 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:26.368557 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:26.369344 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:26.369832 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:26.508896 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.network.security_group_api [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Removing security group fbbdceeb-a7fd-4b8f-ac22-251cf43c5a8d from port a794b84b-dcfe-4fe5-aba5-ed6f81620df8 Jun 21 06:04:26.847523 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1d3cab77-59f8-49be-8483-bf2bab1d2522 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/action" status: 202 len: 0 microversion: 2.1 time: 0.493445 Jun 21 06:04:26.849117 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 549/1115] 10.222.0.18 () {60 vars in 1277 bytes} [Tue Jun 21 06:04:26 2022] POST /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:04:26.863147 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-efeaf110-28a3-4b56-a5b3-ed8a7b11b29a req-7e6a5b55-dc44-4a93-9593-ce3d25a71cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:04:26.874293 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=18 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:26.875876 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:04:26.880394 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-efeaf110-28a3-4b56-a5b3-ed8a7b11b29a req-7e6a5b55-dc44-4a93-9593-ce3d25a71cbf service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:26.881270 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-efeaf110-28a3-4b56-a5b3-ed8a7b11b29a req-7e6a5b55-dc44-4a93-9593-ce3d25a71cbf service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:26.913703 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-efeaf110-28a3-4b56-a5b3-ed8a7b11b29a req-7e6a5b55-dc44-4a93-9593-ce3d25a71cbf service nova] Creating event network-changed:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:04:26.921712 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-efeaf110-28a3-4b56-a5b3-ed8a7b11b29a req-7e6a5b55-dc44-4a93-9593-ce3d25a71cbf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064220 Jun 21 06:04:26.923251 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 567/1116] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:04:28.036420 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:28.036946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:28.043042 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:28.043488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:28.044255 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:28.044689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:28.134133 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lazy-loading 'services' on Instance uuid 6dd7948c-24ee-483b-bdfe-70efebf6ff7a {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:04:28.213506 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1f2b9ea5-2af2-4420-95e2-13f54f9c1506 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments/342829f4-083e-4c3e-8a49-56df446665ed" status: 202 len: 0 microversion: 2.1 time: 0.181278 Jun 21 06:04:28.214490 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 550/1117] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 06:04:28 2022] DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments/342829f4-083e-4c3e-8a49-56df446665ed => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:04:28.224812 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:28.226745 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:28.233987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:28.234785 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:28.235879 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:28.236322 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:28.271974 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a282db29-d9b7-4c3f-8e1d-5d12623b8ac1 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053117 Jun 21 06:04:28.272569 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 568/1118] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:04:28 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:04:28.947196 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-11f94d85-73db-4346-8161-e32729d3a6b7 req-6484410c-ec7a-4423-bd6e-43728427d7ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:04:28.967655 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-11f94d85-73db-4346-8161-e32729d3a6b7 req-6484410c-ec7a-4423-bd6e-43728427d7ea service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:28.968483 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-11f94d85-73db-4346-8161-e32729d3a6b7 req-6484410c-ec7a-4423-bd6e-43728427d7ea service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:28.980717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-11f94d85-73db-4346-8161-e32729d3a6b7 req-6484410c-ec7a-4423-bd6e-43728427d7ea service nova] Creating event network-changed:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:04:28.985856 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-11f94d85-73db-4346-8161-e32729d3a6b7 req-6484410c-ec7a-4423-bd6e-43728427d7ea service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050117 Jun 21 06:04:28.986503 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 551/1119] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:04:29.284736 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:29.285781 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:29.292198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:29.292641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:29.293404 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:29.293832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:29.322520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-419f6a0d-89b4-4c13-805b-8f7ba8b20916 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042389 Jun 21 06:04:29.323095 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 569/1120] 10.222.0.18 () {58 vars in 1301 bytes} [Tue Jun 21 06:04:29 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 21 06:04:29.335419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:29.335419 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:29.341844 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:29.342317 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:29.343083 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:29.343515 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:29.421791 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] HTTP exception thrown: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a is not attached to volume 342829f4-083e-4c3e-8a49-56df446665ed Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Request method failure captured: Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments/342829f4-083e-4c3e-8a49-56df446665ed HTTP/1.1 Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV7iCKm5yrfWZSF7gvbLL-3KD6lOYdh_yTu3EzDpO1Ox0StfqjHmkW_PFZFG1wenUCJ9Jn_7iJo1_EAwLReymhbNJL6kUTynhXAVsT67Uyumksd05pr4N9FgkgvYbDAnq6tcQYW7U82jv2-7IrEPmIJxfegvJbljXorzAXFivY5YgQA Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 391ee53fa68f41a4ac576996b9b52b9d Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-TestMinimumBasicScenario-719032966 Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:04:29.424407 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-TestMinimumBasicScenario-719032966 Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 391ee53fa68f41a4ac576996b9b52b9d Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-TestMinimumBasicScenario-719032966 Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-TestMinimumBasicScenario-719032966-project Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: bab1bde41c394c519663217f6466033e Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-TestMinimumBasicScenario-719032966-project Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:04:29.426234 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a is not attached to volume 342829f4-083e-4c3e-8a49-56df446665ed Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'server_id': '6dd7948c-24ee-483b-bdfe-70efebf6ff7a', 'id': '342829f4-083e-4c3e-8a49-56df446665ed'} Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 342829f4-083e-4c3e-8a49-56df446665ed. Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:04:29.427138 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a is not attached to volume 342829f4-083e-4c3e-8a49-56df446665ed Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a is not attached to volume 342829f4-083e-4c3e-8a49-56df446665ed Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:29.428452 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Returning 404 to user: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a is not attached to volume 342829f4-083e-4c3e-8a49-56df446665ed {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:04:29.429546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-8d5fb87d-c519-401d-a9ce-0953da39730e tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments/342829f4-083e-4c3e-8a49-56df446665ed" status: 404 len: 154 microversion: 2.1 time: 0.096742 Jun 21 06:04:29.429546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 552/1121] 10.222.0.18 () {58 vars in 1415 bytes} [Tue Jun 21 06:04:29 2022] DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a/os-volume_attachments/342829f4-083e-4c3e-8a49-56df446665ed => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 21 06:04:30.578984 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:30.579520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:30.586329 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:30.586783 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:30.587549 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:30.587987 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:30.615136 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Going to try to terminate instance {{(pid=117431) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:04:30.693925 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-f99473e3-f616-4336-89a3-2185e2cc0a23 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 204 len: 0 microversion: 2.1 time: 0.118474 Jun 21 06:04:30.694696 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 570/1122] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:04:30 2022] DELETE /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:04:30.703820 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:30.704429 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:30.712067 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:30.712508 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:30.713304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:30.713693 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:30.848439 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:04:30.856538 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-032c575d-2bca-40ff-b143-b7e1ace78bbb tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1555 microversion: 2.1 time: 0.157271 Jun 21 06:04:30.857116 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 553/1123] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:04:30 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:04:31.874755 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:31.875608 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:31.883218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:31.883651 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:31.884418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:31.884844 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:32.033966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:04:32.042571 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3ca911ea-67a3-4061-869e-86507a74eb6a tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1555 microversion: 2.1 time: 0.172200 Jun 21 06:04:32.043482 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 571/1124] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:04:31 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:04:32.927996 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-6e1b021b-4b2a-4441-bafa-e5abb77abde1 req-5dc894c0-508a-4660-b603-7ce5bb2baea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd7948c-24ee-483b-bdfe-70efebf6ff7a", "name": "network-vif-deleted", "tag": "a794b84b-dcfe-4fe5-aba5-ed6f81620df8"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:04:32.943032 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-6e1b021b-4b2a-4441-bafa-e5abb77abde1 req-5dc894c0-508a-4660-b603-7ce5bb2baea4 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:32.943717 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-6e1b021b-4b2a-4441-bafa-e5abb77abde1 req-5dc894c0-508a-4660-b603-7ce5bb2baea4 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:32.961650 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-6e1b021b-4b2a-4441-bafa-e5abb77abde1 req-5dc894c0-508a-4660-b603-7ce5bb2baea4 service nova] Creating event network-vif-deleted:a794b84b-dcfe-4fe5-aba5-ed6f81620df8 for instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a on hv-cinder-84690 Jun 21 06:04:32.968184 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-6e1b021b-4b2a-4441-bafa-e5abb77abde1 req-5dc894c0-508a-4660-b603-7ce5bb2baea4 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048436 Jun 21 06:04:32.968811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 554/1125] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:04:33.065297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:33.066070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:33.074418 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:33.074970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:33.076342 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:33.077115 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:33.118337 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:33.118683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:33.119137 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.objects.instance [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lazy-loading 'fault' on Instance uuid 6dd7948c-24ee-483b-bdfe-70efebf6ff7a {{(pid=117431) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:04:33.174169 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bab1bde41c394c519663217f6466033e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '391ee53fa68f41a4ac576996b9b52b9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:04:33.185421 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-6cd8e8e7-48f3-4406-84b1-1ceb4b43240d tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 200 len: 1348 microversion: 2.1 time: 0.124177 Jun 21 06:04:33.186352 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 572/1126] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:04:33 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 1348 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:04:34.204804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:34.205527 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] [instance: 6dd7948c-24ee-483b-bdfe-70efebf6ff7a] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:04:34.213223 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:34.213666 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:34.214461 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:04:34.214893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:04:34.231002 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] HTTP exception thrown: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a could not be found. Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Request method failure captured: Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a HTTP/1.1 Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV7iCKm5yrfWZSF7gvbLL-3KD6lOYdh_yTu3EzDpO1Ox0StfqjHmkW_PFZFG1wenUCJ9Jn_7iJo1_EAwLReymhbNJL6kUTynhXAVsT67Uyumksd05pr4N9FgkgvYbDAnq6tcQYW7U82jv2-7IrEPmIJxfegvJbljXorzAXFivY5YgQA Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 391ee53fa68f41a4ac576996b9b52b9d Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-TestMinimumBasicScenario-719032966 Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:04:34.232660 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/391ee53fa68f41a4ac576996b9b52b9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-TestMinimumBasicScenario-719032966 Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 391ee53fa68f41a4ac576996b9b52b9d Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-TestMinimumBasicScenario-719032966 Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-TestMinimumBasicScenario-719032966-project Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: bab1bde41c394c519663217f6466033e Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-TestMinimumBasicScenario-719032966-project Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a could not be found. Jun 21 06:04:34.235283 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '6dd7948c-24ee-483b-bdfe-70efebf6ff7a'} Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a could not be found. Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:04:34.236743 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a could not be found. Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a could not be found. Jun 21 06:04:34.239752 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:04:34.241922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Returning 404 to user: Instance 6dd7948c-24ee-483b-bdfe-70efebf6ff7a could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:04:34.241922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-62ae6303-ae67-4930-851d-08b9f3305b89 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a" status: 404 len: 111 microversion: 2.1 time: 0.033602 Jun 21 06:04:34.241922 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 555/1127] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:04:34 2022] GET /compute/v2.1/servers/6dd7948c-24ee-483b-bdfe-70efebf6ff7a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:04:34.247379 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-13205f26-2396-40eb-a428-375990945582 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] Calling method '.version_select at 0x7efe5c5b9430>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:04:34.266363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-13205f26-2396-40eb-a428-375990945582 tempest-TestMinimumBasicScenario-719032966 tempest-TestMinimumBasicScenario-719032966-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-439521898" status: 202 len: 0 microversion: 2.1 time: 0.022692 Jun 21 06:04:34.267023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 573/1128] 10.222.0.18 () {58 vars in 1268 bytes} [Tue Jun 21 06:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-439521898 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:05:10.319127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:10.319992 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:10.323836 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=14 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:10.324882 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:10.336388 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:10.337192 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:10.338641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:10.339399 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:10.388675 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:05:10.486215 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c69cf178-3da9-47b6-9af5-69da88b8f3bf tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "DELETE /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 204 len: 0 microversion: 2.1 time: 0.173970 Jun 21 06:05:10.492126 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 556/1129] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:05:10 2022] DELETE /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:05:10.495837 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:10.496894 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:10.502023 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:10.502820 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:10.512285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:10.512727 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:10.513521 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:10.514056 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:10.673399 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:10.682683 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8c4a725d-3843-48cb-8ab4-3bc1ac4426d3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1580 microversion: 2.1 time: 0.188330 Jun 21 06:05:10.683512 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 574/1130] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:10 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1580 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:11.702727 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:11.703469 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:11.711343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:11.711795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:11.712568 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:11.713015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:11.863721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:11.872174 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-cf011d47-baf0-4c8d-9c11-1ff91722a02d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1580 microversion: 2.1 time: 0.173851 Jun 21 06:05:11.873048 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 557/1131] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:11 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1580 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:05:12.891052 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:12.891806 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:12.899393 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:12.899788 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:12.900609 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:12.901042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:13.103706 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:13.120234 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-fc99c640-af73-4726-bb9a-91602a18ebcb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 200 len: 1580 microversion: 2.1 time: 0.232955 Jun 21 06:05:13.121430 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 575/1132] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:12 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 1580 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:13.612497 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-2f694cee-f949-49f6-af05-05dafd372630 req-c24075bd-12d9-403c-b6ae-2bbb230fb57a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939ccd30-4a20-413b-82e8-808b352cb342", "name": "network-vif-deleted", "tag": "47194ebb-2e6b-49a5-89ce-156374a9f988"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:05:13.633016 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-2f694cee-f949-49f6-af05-05dafd372630 req-c24075bd-12d9-403c-b6ae-2bbb230fb57a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:13.633956 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-2f694cee-f949-49f6-af05-05dafd372630 req-c24075bd-12d9-403c-b6ae-2bbb230fb57a service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:13.657776 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-2f694cee-f949-49f6-af05-05dafd372630 req-c24075bd-12d9-403c-b6ae-2bbb230fb57a service nova] Creating event network-vif-deleted:47194ebb-2e6b-49a5-89ce-156374a9f988 for instance 939ccd30-4a20-413b-82e8-808b352cb342 on hv-cinder-84690 Jun 21 06:05:13.666946 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-2f694cee-f949-49f6-af05-05dafd372630 req-c24075bd-12d9-403c-b6ae-2bbb230fb57a service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309111 Jun 21 06:05:13.668708 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 558/1133] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:05:14.153726 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:14.157013 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:14.175281 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:14.176899 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:14.178898 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:14.180019 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:14.212153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] HTTP exception thrown: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Request method failure captured: Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 HTTP/1.1 Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV7gfw-kyG5keRKYGzSZBt1ymuw7ld700r5OCS2mc71uwoDclW9Dc5KZikGpfGGrqND0FwlR2mV5JpeUmUj4fLaIw-aIdhXlQOcjWuHQnmIyeRaGMAEJ3u3E_NGFjtGd5HuuRFtH4H7spVJzAPp0C7Qj_kqFFEuhwOtVBJC4j4MQX-M Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:05:14.215156 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-TestVolumeBootPattern-423377196 Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f02739ec12fa4f238244cdcbe1e3d739 Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:05:14.218279 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '939ccd30-4a20-413b-82e8-808b352cb342'} Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:05:14.220086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:05:14.223363 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:05:14.227024 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Returning 404 to user: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:05:14.227935 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-46d3c9fc-5213-485e-a54d-82ed917f8d3b tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 404 len: 111 microversion: 2.1 time: 0.084992 Jun 21 06:05:14.228598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 576/1134] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:14 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:05:14.363904 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1258336024", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1476182596", "security_groups": [{"name": "tempest-secgroup-smoke-1404600577"}], "block_device_mapping_v2": [{"uuid": "00e6af65-cd26-4053-81fe-c3559422e16f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "08118c26-49e5-44b2-ae68-b52c5e4334d2"}]}} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:05:14.558220 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.network.neutron [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] validate_networks() for [('08118c26-49e5-44b2-ae68-b52c5e4334d2', None, None, None, None, None)] {{(pid=117430) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 06:05:15.213955 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Flavor limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 06:05:15.214613 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Image limits 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 06:05:15.215120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Flavor pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 06:05:15.215632 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Image pref 0:0:0 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 06:05:15.216150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.virt.hardware [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117430) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 06:05:15.227803 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:15.228359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:15.229262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:15.229923 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:15.263190 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for project 9405db81e23a4cbbb963f916fbeea605. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 06:05:15.270488 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.quota [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for user f02739ec12fa4f238244cdcbe1e3d739 and project 9405db81e23a4cbbb963f916fbeea605. Resources: {'instances', 'ram', 'cores'} {{(pid=117430) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 06:05:15.348086 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Going to run 1 instances... {{(pid=117430) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 06:05:15.351146 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='00e6af65-cd26-4053-81fe-c3559422e16f',volume_size=None,volume_type=None)] {{(pid=117430) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 06:05:15.513552 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-f8ceb0be-5a05-425d-8808-aa916612efe2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.157880 Jun 21 06:05:15.514663 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 559/1135] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 06:05:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 06:05:15.528510 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5e4095a9-f0e8-4e67-9c68-3eb39095af0c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:15.529814 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5e4095a9-f0e8-4e67-9c68-3eb39095af0c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:15.611351 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5e4095a9-f0e8-4e67-9c68-3eb39095af0c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:15.622257 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5e4095a9-f0e8-4e67-9c68-3eb39095af0c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1095 microversion: 2.1 time: 0.099015 Jun 21 06:05:15.623129 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 577/1136] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:15 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:16.650481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:16.651692 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:16.665462 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:16.666199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:16.667487 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:16.668258 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:16.830900 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:16.846941 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-d6efeb3f-93b5-434f-8adc-63eed0c3299f tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1201 microversion: 2.1 time: 0.204073 Jun 21 06:05:16.848334 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 560/1137] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:16 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1201 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:17.869186 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:17.871544 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:17.886488 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:17.887412 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:17.888961 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:17.890153 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:18.079264 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:18.088946 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-a79f342e-a1ac-43ab-9e9a-2acb3ef1ff1d tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.227166 Jun 21 06:05:18.089561 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 578/1138] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:17 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:18.617610 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-79eb5308-c31d-4626-9570-a048d9b2faa4 req-7ff6fff9-0dbf-486d-afa7-5f03070069a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bd70f-0c59-4654-9d7e-e46cfc49ea83", "tag": "df9b9ab6-5127-46cc-9705-b9896f1e8888"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:05:18.641278 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-79eb5308-c31d-4626-9570-a048d9b2faa4 req-7ff6fff9-0dbf-486d-afa7-5f03070069a1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:18.642150 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-79eb5308-c31d-4626-9570-a048d9b2faa4 req-7ff6fff9-0dbf-486d-afa7-5f03070069a1 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:18.664806 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-79eb5308-c31d-4626-9570-a048d9b2faa4 req-7ff6fff9-0dbf-486d-afa7-5f03070069a1 service nova] Creating event network-changed:df9b9ab6-5127-46cc-9705-b9896f1e8888 for instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 on hv-cinder-84690 Jun 21 06:05:18.675649 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-79eb5308-c31d-4626-9570-a048d9b2faa4 req-7ff6fff9-0dbf-486d-afa7-5f03070069a1 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067911 Jun 21 06:05:18.677430 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 561/1139] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:05:19.107534 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:19.108972 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:19.117441 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:19.118411 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:19.119468 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:19.120018 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:19.275525 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:19.284801 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-e726181c-7a73-444a-9575-b76444e2a2e1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.180758 Jun 21 06:05:19.285395 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 579/1140] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:19 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:20.302953 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:20.303560 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:20.310107 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:20.310546 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:20.311320 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:20.311753 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:20.471108 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:20.486149 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-92af76c6-d1af-4ac2-8095-1ff6680928d4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.187366 Jun 21 06:05:20.487926 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 562/1141] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:20 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:21.508870 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:21.509903 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:21.520620 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:21.521368 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:21.522717 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:21.523495 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:21.676710 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:21.684778 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-097d099a-39dd-4376-b641-1cf32fead7e6 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.183096 Jun 21 06:05:21.685376 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 580/1142] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:21 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:22.702674 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:22.703374 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:22.711015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:22.711742 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:22.712650 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:22.713091 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:22.867270 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:22.875330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e10d2e96-b94f-4495-904c-9234b26a8c35 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.176626 Jun 21 06:05:22.875905 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 563/1143] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:22 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:23.893575 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:23.894583 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:23.902010 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:23.902442 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:23.903323 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:23.903854 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:24.053015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:24.062716 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-3cba8b3d-593f-40b0-af92-50f91e55e97c tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.173109 Jun 21 06:05:24.063313 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 581/1144] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:23 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:05:25.082346 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:25.082991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:25.091130 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:25.091724 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:25.092673 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:25.093249 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:25.242304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:25.244804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:25.251790 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6a0691a0-b423-466c-95bd-31f7be1b7034 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.173406 Jun 21 06:05:25.252437 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 564/1145] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:25 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:26.270067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:26.270757 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:26.273312 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:26.279026 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:26.279481 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:26.280276 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:26.280714 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:26.434919 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:26.443863 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-5890ac62-9397-4e7f-9d70-1fcc6d8cb178 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.178610 Jun 21 06:05:26.444459 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 582/1146] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:26 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:27.462005 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:27.463410 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:27.465429 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=6 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:05:27.471617 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:27.472062 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:27.473090 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:27.473345 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:27.619575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:27.627098 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-bb13f103-3ef2-4391-8cee-5ab8f6933b44 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.169749 Jun 21 06:05:27.628261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 565/1147] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:27 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:28.647668 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:28.648797 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:28.658982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:28.659425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:28.660218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:28.660643 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:28.813203 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:28.824292 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-60245e85-e68b-46ac-8fcd-f3a38b2ff619 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.183862 Jun 21 06:05:28.824912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 583/1148] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:28 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:29.042043 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-0d17f6b5-7837-4b41-b5ef-de1f486f4050 req-dc29e504-dfbb-4fd8-82ed-1d57c49bb313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6bd70f-0c59-4654-9d7e-e46cfc49ea83", "name": "network-vif-plugged", "status": "completed", "tag": "df9b9ab6-5127-46cc-9705-b9896f1e8888"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:05:29.050940 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-0d17f6b5-7837-4b41-b5ef-de1f486f4050 req-dc29e504-dfbb-4fd8-82ed-1d57c49bb313 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:29.051380 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-0d17f6b5-7837-4b41-b5ef-de1f486f4050 req-dc29e504-dfbb-4fd8-82ed-1d57c49bb313 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:29.064330 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-0d17f6b5-7837-4b41-b5ef-de1f486f4050 req-dc29e504-dfbb-4fd8-82ed-1d57c49bb313 service nova] Creating event network-vif-plugged:df9b9ab6-5127-46cc-9705-b9896f1e8888 for instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 on hv-cinder-84690 Jun 21 06:05:29.070639 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-0d17f6b5-7837-4b41-b5ef-de1f486f4050 req-dc29e504-dfbb-4fd8-82ed-1d57c49bb313 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107521 Jun 21 06:05:29.071577 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 566/1149] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:05:29.848597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:29.849321 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:29.856593 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:29.857042 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:29.857843 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:29.858324 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:30.023212 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:30.031793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-bec71f5a-fec8-48ae-bada-f2efe386f9fc tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1267 microversion: 2.1 time: 0.187272 Jun 21 06:05:30.032390 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 584/1150] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:29 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:31.050195 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:31.050838 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:31.057897 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:31.058481 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:31.059316 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:31.059760 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:31.216485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:31.225479 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-e00f551f-f6cb-496f-9048-bf4936af6217 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1454 microversion: 2.1 time: 0.180166 Jun 21 06:05:31.226101 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 567/1151] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:31 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:31.242622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:05:31.243258 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:05:31.250224 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:31.250676 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:31.251463 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:31.251900 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:31.403311 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:05:31.412217 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-96536abb-e5d8-4dc9-bfd6-24bd2589c569 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1454 microversion: 2.1 time: 0.173375 Jun 21 06:05:31.412970 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 585/1152] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:05:31 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1454 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:05:33.286302 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-2d9bef16-ad9a-4c4b-94aa-105df13ca587 req-0ed1ff8c-03ba-4641-9558-303ddf6dda53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bd70f-0c59-4654-9d7e-e46cfc49ea83", "tag": "df9b9ab6-5127-46cc-9705-b9896f1e8888"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:05:33.298795 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-2d9bef16-ad9a-4c4b-94aa-105df13ca587 req-0ed1ff8c-03ba-4641-9558-303ddf6dda53 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:05:33.299687 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-2d9bef16-ad9a-4c4b-94aa-105df13ca587 req-0ed1ff8c-03ba-4641-9558-303ddf6dda53 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:05:33.321811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-2d9bef16-ad9a-4c4b-94aa-105df13ca587 req-0ed1ff8c-03ba-4641-9558-303ddf6dda53 service nova] Creating event network-changed:df9b9ab6-5127-46cc-9705-b9896f1e8888 for instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 on hv-cinder-84690 Jun 21 06:05:33.331485 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-2d9bef16-ad9a-4c4b-94aa-105df13ca587 req-0ed1ff8c-03ba-4641-9558-303ddf6dda53 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112393 Jun 21 06:05:33.332704 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 568/1153] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:05:52.594988 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:05:52.596197 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Tue Jun 21 06:05:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:07:07.980318 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=26 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:07.981148 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=62 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:07.985540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1920785817", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1476182596", "security_groups": [{"name": "tempest-secgroup-smoke-1404600577"}], "block_device_mapping_v2": [{"uuid": "be1e1d69-e340-48d4-a9c0-ebe6ab0a82b1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "08118c26-49e5-44b2-ae68-b52c5e4334d2"}]}} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:07:08.106923 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.network.neutron [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] validate_networks() for [('08118c26-49e5-44b2-ae68-b52c5e4334d2', None, None, None, None, None)] {{(pid=117431) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 21 06:07:08.639396 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Flavor limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 21 06:07:08.639891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Image limits 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 21 06:07:08.640403 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Flavor pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 21 06:07:08.640918 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Image pref 0:0:0 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 21 06:07:08.641630 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.virt.hardware [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117431) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 21 06:07:08.652314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:08.652746 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:08.653639 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:08.654096 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:08.676476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for project 9405db81e23a4cbbb963f916fbeea605. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 21 06:07:08.682043 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.quota [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Getting quotas for user f02739ec12fa4f238244cdcbe1e3d739 and project 9405db81e23a4cbbb963f916fbeea605. Resources: {'instances', 'ram', 'cores'} {{(pid=117431) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 21 06:07:08.741051 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Going to run 1 instances... {{(pid=117431) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 21 06:07:08.743178 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='be1e1d69-e340-48d4-a9c0-ebe6ab0a82b1',volume_size=None,volume_type=None)] {{(pid=117431) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 21 06:07:08.875969 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-72951e6f-c364-4daa-a45b-4da03af91b33 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.897522 Jun 21 06:07:08.876592 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 586/1154] 10.222.0.18 () {60 vars in 1146 bytes} [Tue Jun 21 06:07:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 21 06:07:08.885477 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:08.886237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:08.892127 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6088a457-b27e-46b8-a45c-95d5efc62072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:08.894058 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6088a457-b27e-46b8-a45c-95d5efc62072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:08.952547 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6088a457-b27e-46b8-a45c-95d5efc62072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:08.960081 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6088a457-b27e-46b8-a45c-95d5efc62072 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1095 microversion: 2.1 time: 0.077091 Jun 21 06:07:08.960634 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 569/1155] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:08 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:09.986275 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:09.986891 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:09.994597 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:09.995044 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:09.995817 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:09.996246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:10.058636 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:10.067551 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8c6d1103-7e7e-4e12-86cb-7ac867a5f8ae tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1211 microversion: 2.1 time: 0.087642 Jun 21 06:07:10.068198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 587/1156] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:09 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:11.084769 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:11.085376 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:11.094347 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:11.094796 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:11.095593 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:11.096037 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:11.251943 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:11.260160 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-4c4d1f71-a14c-46d2-a695-fb4effea2826 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.179236 Jun 21 06:07:11.268575 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 570/1157] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:11 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:11.274688 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-b341c9ef-a771-46a9-bbc6-268d43db1c19 req-20434c99-100f-4702-9782-d8471f249301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef97bf11-d8cd-480b-a504-3ba94d2ee09f", "tag": "e5407028-d5f4-462a-8c85-42951794c530"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:07:11.283622 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-b341c9ef-a771-46a9-bbc6-268d43db1c19 req-20434c99-100f-4702-9782-d8471f249301 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:11.283982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-b341c9ef-a771-46a9-bbc6-268d43db1c19 req-20434c99-100f-4702-9782-d8471f249301 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:11.314443 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-b341c9ef-a771-46a9-bbc6-268d43db1c19 req-20434c99-100f-4702-9782-d8471f249301 service nova] Creating event network-changed:e5407028-d5f4-462a-8c85-42951794c530 for instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f on hv-cinder-84690 Jun 21 06:07:11.319860 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-b341c9ef-a771-46a9-bbc6-268d43db1c19 req-20434c99-100f-4702-9782-d8471f249301 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048792 Jun 21 06:07:11.320470 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 588/1158] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:07:12.277534 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:12.278185 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:12.284786 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:12.285233 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:12.286018 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:12.286457 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:12.429460 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:12.437261 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-5fbbe7cc-a5ee-4ac0-8167-58ea2b320c86 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.164017 Jun 21 06:07:12.437826 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 571/1159] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:12 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:13.456739 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:13.457377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:13.464297 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:13.464771 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:13.465557 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:13.466005 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:13.622445 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:13.631157 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-4c59b1b7-44da-4753-8d86-e908fe8f2cfd tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.179838 Jun 21 06:07:13.631775 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 589/1160] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:13 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:14.648343 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:14.648951 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:14.655590 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:14.656031 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:14.656798 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:14.657226 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:14.802059 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:14.810183 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-24e0f80f-bc32-4507-98ef-eaa37fd1dfd4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.165643 Jun 21 06:07:14.810812 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 572/1161] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:14 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:15.828162 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:15.828804 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:15.837154 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:15.837595 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:15.838679 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:15.839393 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:15.990540 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:15.998365 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-0808a409-daa4-4358-9927-b86ad3bb6603 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.174034 Jun 21 06:07:15.998939 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 590/1162] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:15 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:17.018913 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:17.020033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:17.031559 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:17.032189 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:17.033571 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:17.034395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:17.471473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:17.480045 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6fd1defe-8b51-49d5-a7a3-d1db3d15f6df tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.467992 Jun 21 06:07:17.480629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 573/1163] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:17 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:18.498869 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:18.499753 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:18.507446 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:18.507900 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:18.508681 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:18.509114 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:18.647198 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:18.654623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-92a93fe8-6fae-4ae2-9291-655db8f622a3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.160730 Jun 21 06:07:18.655185 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 591/1164] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:18 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:19.673474 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell0:SELECT=2 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:19.786632 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:19.787339 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:19.795077 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:19.795524 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:19.796312 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:19.796749 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:19.944536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:19.952680 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-ea6ceaea-6102-4fa6-9c74-78ee18a241de tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.284622 Jun 21 06:07:19.953281 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 574/1165] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:19 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:20.973598 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:20.974246 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:20.976330 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=2 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:20.977208 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell0:SELECT=6 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:07:20.983742 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:20.984177 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:20.984948 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:20.985377 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:21.136699 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:21.145646 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-705297e9-4f8f-460b-80ef-7fe54df1d651 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.175834 Jun 21 06:07:21.146263 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 592/1166] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:20 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:22.163368 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:22.164085 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:22.170949 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:22.171390 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:22.172169 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:22.172600 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:22.320609 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:22.328955 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-692a7dba-c1c9-4f93-a5b1-699185ec4267 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.169638 Jun 21 06:07:22.329536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 575/1167] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:22 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:07:23.348935 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:23.349878 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:23.356638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:23.357086 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:23.357848 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:23.358314 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:23.455252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [req-59dc951d-10b7-49a3-a069-6c16d7709eb4 req-30f00bdd-1ac1-4b5d-9ad2-0f3f4b679f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef97bf11-d8cd-480b-a504-3ba94d2ee09f", "name": "network-vif-plugged", "status": "completed", "tag": "e5407028-d5f4-462a-8c85-42951794c530"}]} {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:07:23.465286 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-59dc951d-10b7-49a3-a069-6c16d7709eb4 req-30f00bdd-1ac1-4b5d-9ad2-0f3f4b679f92 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:23.465721 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [req-59dc951d-10b7-49a3-a069-6c16d7709eb4 req-30f00bdd-1ac1-4b5d-9ad2-0f3f4b679f92 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:23.479033 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.compute.server_external_events [req-59dc951d-10b7-49a3-a069-6c16d7709eb4 req-30f00bdd-1ac1-4b5d-9ad2-0f3f4b679f92 service nova] Creating event network-vif-plugged:e5407028-d5f4-462a-8c85-42951794c530 for instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f on hv-cinder-84690 Jun 21 06:07:23.497260 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [req-59dc951d-10b7-49a3-a069-6c16d7709eb4 req-30f00bdd-1ac1-4b5d-9ad2-0f3f4b679f92 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045449 Jun 21 06:07:23.502359 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 576/1168] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:07:23.525199 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:23.532158 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-66e7d431-23f9-46d3-9289-60276c2825b1 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.186989 Jun 21 06:07:23.532752 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 593/1169] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:23 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:24.550514 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:24.551120 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:24.557971 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:24.558417 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:24.559186 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:24.559619 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:24.700176 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:24.708425 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-77a6540f-659c-4b76-b688-28ec8f1d248a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1267 microversion: 2.1 time: 0.162778 Jun 21 06:07:24.709002 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 577/1170] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:24 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:24.952536 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:07:24.952799 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Tue Jun 21 06:07:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:07:25.726943 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:25.727534 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:25.734218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:25.734664 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:25.735425 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:25.735855 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:25.879832 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:25.887451 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-c58aee54-97f5-4ca0-9cd2-e0cd57af366e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1455 microversion: 2.1 time: 0.164378 Jun 21 06:07:25.888003 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 594/1171] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:25 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1455 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:25.904403 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:07:25.905020 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:07:25.912945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:25.913426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:25.914269 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:25.914704 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:26.056509 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:07:26.064398 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-c1d0d95e-558d-458d-8578-ed470fb6aab4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1455 microversion: 2.1 time: 0.163783 Jun 21 06:07:26.064971 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 578/1172] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:07:25 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:07:27.782960 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-2d096b8a-a97e-468b-be1c-e6e309e353d4 req-cca1a663-90ad-40c1-aaf8-a49b491fecaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef97bf11-d8cd-480b-a504-3ba94d2ee09f", "tag": "e5407028-d5f4-462a-8c85-42951794c530"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:07:27.792206 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-2d096b8a-a97e-468b-be1c-e6e309e353d4 req-cca1a663-90ad-40c1-aaf8-a49b491fecaf service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:07:27.792641 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-2d096b8a-a97e-468b-be1c-e6e309e353d4 req-cca1a663-90ad-40c1-aaf8-a49b491fecaf service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:07:27.806966 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-2d096b8a-a97e-468b-be1c-e6e309e353d4 req-cca1a663-90ad-40c1-aaf8-a49b491fecaf service nova] Creating event network-changed:e5407028-d5f4-462a-8c85-42951794c530 for instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f on hv-cinder-84690 Jun 21 06:07:27.812515 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-2d096b8a-a97e-468b-be1c-e6e309e353d4 req-cca1a663-90ad-40c1-aaf8-a49b491fecaf service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033152 Jun 21 06:07:27.813301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 595/1173] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:07:33.612290 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:07:33.612944 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Tue Jun 21 06:07:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:08:56.485521 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_api:SELECT=22 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:08:56.487241 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG dbcounter [-] [117430] Writing DB stats nova_cell1:SELECT=50 {{(pid=117430) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:08:56.488997 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:08:56.492585 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG dbcounter [-] [117431] Writing DB stats nova_cell1:SELECT=48 {{(pid=117431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 06:08:56.498404 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:08:56.499278 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:08:56.501582 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-7c41c614-9880-4e7c-8b08-239249bfa3a2 req-4786ea53-2099-49f4-98f2-f170be5749ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef97bf11-d8cd-480b-a504-3ba94d2ee09f", "tag": "e5407028-d5f4-462a-8c85-42951794c530"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:08:56.513216 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:56.514436 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:56.516015 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:56.516804 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:56.519925 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-7c41c614-9880-4e7c-8b08-239249bfa3a2 req-4786ea53-2099-49f4-98f2-f170be5749ec service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:56.520772 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-7c41c614-9880-4e7c-8b08-239249bfa3a2 req-4786ea53-2099-49f4-98f2-f170be5749ec service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:56.545195 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-7c41c614-9880-4e7c-8b08-239249bfa3a2 req-4786ea53-2099-49f4-98f2-f170be5749ec service nova] Creating event network-changed:e5407028-d5f4-462a-8c85-42951794c530 for instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f on hv-cinder-84690 Jun 21 06:08:56.555301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-7c41c614-9880-4e7c-8b08-239249bfa3a2 req-4786ea53-2099-49f4-98f2-f170be5749ec service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070115 Jun 21 06:08:56.556981 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 596/1174] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:08:56.568712 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:08:56.694970 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-6399fd46-bd60-4ddc-9897-3b3670d3b2d8 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "DELETE /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 204 len: 0 microversion: 2.1 time: 0.212555 Jun 21 06:08:56.696401 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 579/1175] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:08:56 2022] DELETE /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:08:56.707615 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:08:56.708398 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:08:56.716906 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:56.717389 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:56.718227 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:56.718655 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:56.950845 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:08:56.964502 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1cb97a43-f44e-4e80-9c40-b8de48c73a60 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1580 microversion: 2.1 time: 0.262601 Jun 21 06:08:56.965793 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 597/1176] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:08:56 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1580 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:08:58.000239 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:08:58.001074 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:08:58.010029 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:58.010497 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:58.011292 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:58.011735 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:58.231137 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:08:58.246646 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-0c8db0b0-4236-4d80-b05a-7119366be7c2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1580 microversion: 2.1 time: 0.256077 Jun 21 06:08:58.247726 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 580/1177] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:08:57 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1580 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:08:58.979687 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-addcc394-78d1-40e4-8fb5-51ba64a8ecac req-aea36946-0727-4b31-8c37-42d82a4f403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef97bf11-d8cd-480b-a504-3ba94d2ee09f", "name": "network-vif-deleted", "tag": "e5407028-d5f4-462a-8c85-42951794c530"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:08:58.990455 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-addcc394-78d1-40e4-8fb5-51ba64a8ecac req-aea36946-0727-4b31-8c37-42d82a4f403b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:58.990894 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-addcc394-78d1-40e4-8fb5-51ba64a8ecac req-aea36946-0727-4b31-8c37-42d82a4f403b service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:59.003041 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-addcc394-78d1-40e4-8fb5-51ba64a8ecac req-aea36946-0727-4b31-8c37-42d82a4f403b service nova] Creating event network-vif-deleted:e5407028-d5f4-462a-8c85-42951794c530 for instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f on hv-cinder-84690 Jun 21 06:08:59.009015 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-addcc394-78d1-40e4-8fb5-51ba64a8ecac req-aea36946-0727-4b31-8c37-42d82a4f403b service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Jun 21 06:08:59.009633 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 598/1178] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 21 06:08:59.269836 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:08:59.270338 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:08:59.291627 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:59.292237 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:59.293262 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:08:59.293811 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:08:59.367962 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:08:59.378577 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9a3931f2-976e-4fcd-9b0b-f480520a46a4 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 200 len: 1226 microversion: 2.1 time: 0.115401 Jun 21 06:08:59.386693 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 581/1179] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:08:59 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 1226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:09:00.407070 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:00.408476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: ef97bf11-d8cd-480b-a504-3ba94d2ee09f] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:00.421038 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:00.421787 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:00.423277 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:00.423982 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:00.449620 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] HTTP exception thrown: Instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f could not be found. Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Request method failure captured: Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f HTTP/1.1 Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV7gfw-kyG5keRKYGzSZBt1ymuw7ld700r5OCS2mc71uwoDclW9Dc5KZikGpfGGrqND0FwlR2mV5JpeUmUj4fLaIw-aIdhXlQOcjWuHQnmIyeRaGMAEJ3u3E_NGFjtGd5HuuRFtH4H7spVJzAPp0C7Qj_kqFFEuhwOtVBJC4j4MQX-M Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:09:00.452933 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f02739ec12fa4f238244cdcbe1e3d739 Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f could not be found. Jun 21 06:09:00.455353 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': 'ef97bf11-d8cd-480b-a504-3ba94d2ee09f'} Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f could not be found. Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:09:00.457142 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f could not be found. Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f could not be found. Jun 21 06:09:00.462259 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:00.464728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Returning 404 to user: Instance ef97bf11-d8cd-480b-a504-3ba94d2ee09f could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:09:00.464728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-18f48821-1b2b-4306-92e8-c491cb9f0377 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f" status: 404 len: 111 microversion: 2.1 time: 0.057779 Jun 21 06:09:00.464728 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 599/1180] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:09:00 2022] GET /compute/v2.1/servers/ef97bf11-d8cd-480b-a504-3ba94d2ee09f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:09:03.716535 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:03.717135 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-6553e474-45d9-4ecf-950d-afe5e3bce8eb req-4c2772ed-62b3-48db-857b-82dedd26fd80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bd70f-0c59-4654-9d7e-e46cfc49ea83", "tag": "df9b9ab6-5127-46cc-9705-b9896f1e8888"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:09:03.718252 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:03.725493 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:03.726708 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6553e474-45d9-4ecf-950d-afe5e3bce8eb req-4c2772ed-62b3-48db-857b-82dedd26fd80 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:03.727181 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:03.727349 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-6553e474-45d9-4ecf-950d-afe5e3bce8eb req-4c2772ed-62b3-48db-857b-82dedd26fd80 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:03.727498 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:03.727498 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:03.738360 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-6553e474-45d9-4ecf-950d-afe5e3bce8eb req-4c2772ed-62b3-48db-857b-82dedd26fd80 service nova] Creating event network-changed:df9b9ab6-5127-46cc-9705-b9896f1e8888 for instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 on hv-cinder-84690 Jun 21 06:09:03.744603 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-6553e474-45d9-4ecf-950d-afe5e3bce8eb req-4c2772ed-62b3-48db-857b-82dedd26fd80 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031556 Jun 21 06:09:03.745271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 600/1181] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:09:03.762689 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Going to try to terminate instance {{(pid=117430) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 21 06:09:03.870991 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-356f4960-e0cf-4d22-95e0-60a7dd483347 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "DELETE /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 204 len: 0 microversion: 2.1 time: 0.158328 Jun 21 06:09:03.871945 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 582/1182] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:09:03 2022] DELETE /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 21 06:09:03.888211 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:03.891447 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:03.899838 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:03.900611 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:03.901599 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:03.902280 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:04.052476 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.policy [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117431) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:09:04.062125 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-8a798d18-180c-405f-acd4-b76ac157a066 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1577 microversion: 2.1 time: 0.184846 Jun 21 06:09:04.063045 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 601/1183] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:09:03 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:09:05.079909 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:05.080605 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:05.087862 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:05.088303 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:05.089339 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:05.089766 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:05.231282 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:09:05.247304 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-1bdb8b8b-64db-404d-94f8-1a9ef765252e tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1577 microversion: 2.1 time: 0.171623 Jun 21 06:09:05.247893 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 583/1184] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:09:05 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 21 06:09:05.840865 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [req-c5a61a12-b729-436a-b228-2ae83e479229 req-303ca94a-fafa-4061-8de6-e3218cec5355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6bd70f-0c59-4654-9d7e-e46cfc49ea83", "name": "network-vif-deleted", "tag": "df9b9ab6-5127-46cc-9705-b9896f1e8888"}]} {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 21 06:09:05.851628 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-c5a61a12-b729-436a-b228-2ae83e479229 req-303ca94a-fafa-4061-8de6-e3218cec5355 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:05.852067 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [req-c5a61a12-b729-436a-b228-2ae83e479229 req-303ca94a-fafa-4061-8de6-e3218cec5355 service nova] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:05.864912 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.compute.server_external_events [req-c5a61a12-b729-436a-b228-2ae83e479229 req-303ca94a-fafa-4061-8de6-e3218cec5355 service nova] Creating event network-vif-deleted:df9b9ab6-5127-46cc-9705-b9896f1e8888 for instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 on hv-cinder-84690 Jun 21 06:09:05.870546 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [req-c5a61a12-b729-436a-b228-2ae83e479229 req-303ca94a-fafa-4061-8de6-e3218cec5355 service nova] 10.222.0.18 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033673 Jun 21 06:09:05.871163 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 602/1185] 10.222.0.18 () {64 vars in 1317 bytes} [Tue Jun 21 06:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 21 06:09:06.276857 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:06.277477 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:06.283967 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:06.284418 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:06.285199 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:06.285636 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:06.318763 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:06.319706 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:06.320167 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.objects.instance [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lazy-loading 'fault' on Instance uuid 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 {{(pid=117430) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 21 06:09:06.363002 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.policy [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02739ec12fa4f238244cdcbe1e3d739', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9405db81e23a4cbbb963f916fbeea605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117430) authorize /opt/stack/nova/nova/policy.py:199}} Jun 21 06:09:06.371001 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-7d7ec1bf-8480-4e23-a034-7ef1ef98c40a tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 200 len: 1231 microversion: 2.1 time: 0.102987 Jun 21 06:09:06.371588 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 584/1186] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:09:06 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 21 06:09:07.398893 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:07.399514 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:07.406100 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:07.406554 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:07.407356 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:07.407890 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:07.422839 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] HTTP exception thrown: Instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 could not be found. Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Request method failure captured: Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 HTTP/1.1 Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV7gfw-kyG5keRKYGzSZBt1ymuw7ld700r5OCS2mc71uwoDclW9Dc5KZikGpfGGrqND0FwlR2mV5JpeUmUj4fLaIw-aIdhXlQOcjWuHQnmIyeRaGMAEJ3u3E_NGFjtGd5HuuRFtH4H7spVJzAPp0C7Qj_kqFFEuhwOtVBJC4j4MQX-M Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:09:07.424506 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f02739ec12fa4f238244cdcbe1e3d739 Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 could not be found. Jun 21 06:09:07.426520 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '4d6bd70f-0c59-4654-9d7e-e46cfc49ea83'} Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 could not be found. Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:09:07.427570 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 could not be found. Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 could not be found. Jun 21 06:09:07.429271 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.430751 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Returning 404 to user: Instance 4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:09:07.430751 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-ee836255-9935-406d-ad3c-805b220f27b3 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83" status: 404 len: 111 microversion: 2.1 time: 0.032665 Jun 21 06:09:07.430751 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 603/1187] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:09:07 2022] GET /compute/v2.1/servers/4d6bd70f-0c59-4654-9d7e-e46cfc49ea83 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:09:07.907816 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:07.908393 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.compute.api [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117430) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:07.915723 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:07.916177 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:07.916960 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:07.917387 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG oslo_concurrency.lockutils [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117430) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:07.932852 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.wsgi [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] HTTP exception thrown: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Request method failure captured: Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: request: DELETE /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 HTTP/1.1 Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept: application/json Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Accept-Encoding: identity Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Connection: close Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Length: 0 Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Content-Type: application/json Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Host: 10.222.0.18 Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Openstack-System-Scope: None Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: User-Agent: python-urllib3/1.26.9 Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Auth-Token: gAAAAABisV7gfw-kyG5keRKYGzSZBt1ymuw7ld700r5OCS2mc71uwoDclW9Dc5KZikGpfGGrqND0FwlR2mV5JpeUmUj4fLaIw-aIdhXlQOcjWuHQnmIyeRaGMAEJ3u3E_NGFjtGd5HuuRFtH4H7spVJzAPp0C7Qj_kqFFEuhwOtVBJC4j4MQX-M Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Id: None Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Domain-Name: None Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Identity-Status: Confirmed Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Is-Admin-Project: True Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Id: default Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Domain-Name: Default Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Project-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Role: reader,member Jun 21 06:09:07.934618 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Roles: reader,member Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-Tenant-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Id: default Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Domain-Name: Default Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Id: f02739ec12fa4f238244cdcbe1e3d739 Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: X-User-Name: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: method: > Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: exception: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.936473 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: action_args: {'id': '939ccd30-4a20-413b-82e8-808b352cb342'} Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:09:07.937426 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.939123 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.940629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Returning 404 to user: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. {{(pid=117430) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:09:07.940629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-9a45472e-9208-4138-8593-675ce742e3cb tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "DELETE /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 404 len: 111 microversion: 2.1 time: 0.032197 Jun 21 06:09:07.940629 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 585/1188] 10.222.0.18 () {58 vars in 1238 bytes} [Tue Jun 21 06:09:07 2022] DELETE /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:09:07.948519 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '>' {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:07.949218 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.compute.api [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] [instance: 939ccd30-4a20-413b-82e8-808b352cb342] Fetching instance by UUID {{(pid=117431) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 21 06:09:07.956638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:07.957316 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:07.958750 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 21 06:09:07.959701 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG oslo_concurrency.lockutils [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Lock "6e3921fb-c59b-4ca6-b53d-6a0f3973a431" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 21 06:09:07.984638 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.wsgi [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] HTTP exception thrown: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Request method failure captured: Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: request: GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 HTTP/1.1 Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept: application/json Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Accept-Encoding: identity Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Connection: close Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Length: 0 Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Content-Type: application/json Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Host: 10.222.0.18 Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Openstack-System-Scope: None Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: User-Agent: python-urllib3/1.26.9 Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Auth-Token: gAAAAABisV7gfw-kyG5keRKYGzSZBt1ymuw7ld700r5OCS2mc71uwoDclW9Dc5KZikGpfGGrqND0FwlR2mV5JpeUmUj4fLaIw-aIdhXlQOcjWuHQnmIyeRaGMAEJ3u3E_NGFjtGd5HuuRFtH4H7spVJzAPp0C7Qj_kqFFEuhwOtVBJC4j4MQX-M Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Id: None Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Domain-Name: None Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Identity-Status: Confirmed Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Is-Admin-Project: True Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Id: default Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Domain-Name: Default Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Project-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Role: reader,member Jun 21 06:09:07.986480 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Roles: reader,member Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.18:8080", "publicURL": "http://10.222.0.18:8080/v1/AUTH_9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/volume/v3/9405db81e23a4cbbb963f916fbeea605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.18:9696/"}]}] Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Id: 9405db81e23a4cbbb963f916fbeea605 Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-Tenant-Name: tempest-TestVolumeBootPattern-423377196 Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Id: default Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Domain-Name: Default Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Id: f02739ec12fa4f238244cdcbe1e3d739 Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: X-User-Name: tempest-TestVolumeBootPattern-423377196-project Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: method: > Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: exception: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.988422 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: action_args: {'id': '939ccd30-4a20-413b-82e8-808b352cb342'} Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: {{(pid=117431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 21 06:09:07.989623 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. Jun 21 06:09:07.992339 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: ERROR nova.api.openstack.wsgi Jun 21 06:09:07.994285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: DEBUG nova.api.openstack.wsgi [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Returning 404 to user: Instance 939ccd30-4a20-413b-82e8-808b352cb342 could not be found. {{(pid=117431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 21 06:09:07.994285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO nova.api.openstack.requestlog [None req-1fa176e5-8ae3-4f4e-868f-65f35dd25ce5 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342" status: 404 len: 111 microversion: 2.1 time: 0.046574 Jun 21 06:09:07.994285 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: [pid: 117431|app: 0|req: 604/1189] 10.222.0.18 () {58 vars in 1235 bytes} [Tue Jun 21 06:09:07 2022] GET /compute/v2.1/servers/939ccd30-4a20-413b-82e8-808b352cb342 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 21 06:09:09.322981 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: DEBUG nova.api.openstack.wsgi [None req-06e61fc5-9106-44d4-87ae-72b2061ebdb2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] Calling method '.version_select at 0x7efe5c6c88b0>' {{(pid=117430) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 21 06:09:09.350318 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO nova.api.openstack.requestlog [None req-06e61fc5-9106-44d4-87ae-72b2061ebdb2 tempest-TestVolumeBootPattern-423377196 tempest-TestVolumeBootPattern-423377196-project] 10.222.0.18 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1476182596" status: 202 len: 0 microversion: 2.1 time: 0.031390 Jun 21 06:09:09.351386 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: [pid: 117430|app: 0|req: 586/1190] 10.222.0.18 () {58 vars in 1262 bytes} [Tue Jun 21 06:09:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1476182596 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 21 06:10:53.621719 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:10:53.622430 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Tue Jun 21 06:10:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:10:53.943305 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:10:53.943872 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Tue Jun 21 06:10:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:12:24.964641 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:12:24.965747 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Tue Jun 21 06:12:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:12:32.610296 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:12:32.610804 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Tue Jun 21 06:12:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:14:13.630119 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:14:13.631301 dv-cinder-846901-1-iscsi devstack@n-api.service[117431]: Tue Jun 21 06:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 21 06:14:13.952395 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 21 06:14:13.952989 dv-cinder-846901-1-iscsi devstack@n-api.service[117430]: Tue Jun 21 06:14:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!